-- Logs begin at Sun 2022-09-11 14:26:13 UTC, end at Sun 2022-09-11 15:23:26 UTC. -- Sep 11 14:52:47.897273 dv-cinder-856971-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 14:52:47.905179 dv-cinder-856971-1-smb devstack@keystone.service[81372]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 14:52:47 2022] *** Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: nodename: dv-cinder-856971-1-smb Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: machine: x86_64 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: clock source: unix Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: pcre jit disabled Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: detected number of CPU cores: 4 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: current working directory: / Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: detected binary path: /usr/bin/uwsgi-core Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: your processes number limit is 47680 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: your memory page size is 4096 bytes Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: detected max file descriptor number: 2048 Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: lock engine: pthread robust mutexes Sep 11 14:52:47.908547 dv-cinder-856971-1-smb devstack@keystone.service[81372]: thunder lock: enabled Sep 11 14:52:47.909306 dv-cinder-856971-1-smb devstack@keystone.service[81372]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 14:52:47.909306 dv-cinder-856971-1-smb devstack@keystone.service[81372]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 14:52:47.950081 dv-cinder-856971-1-smb devstack@keystone.service[81372]: Python main interpreter initialized at 0x55b5825799c0 Sep 11 14:52:47.950081 dv-cinder-856971-1-smb devstack@keystone.service[81372]: python threads support enabled Sep 11 14:52:47.950081 dv-cinder-856971-1-smb devstack@keystone.service[81372]: your server socket listen backlog is limited to 100 connections Sep 11 14:52:47.950081 dv-cinder-856971-1-smb devstack@keystone.service[81372]: your mercy for graceful operations on workers is 90 seconds Sep 11 14:52:47.950484 dv-cinder-856971-1-smb devstack@keystone.service[81372]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 14:52:47.950575 dv-cinder-856971-1-smb devstack@keystone.service[81372]: *** Operational MODE: preforking *** Sep 11 14:52:47.950822 dv-cinder-856971-1-smb devstack@keystone.service[81372]: *** uWSGI is running in multiple interpreter mode *** Sep 11 14:52:47.950822 dv-cinder-856971-1-smb devstack@keystone.service[81372]: spawned uWSGI master process (pid: 81372) Sep 11 14:52:47.951027 dv-cinder-856971-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 11 14:52:47.951789 dv-cinder-856971-1-smb devstack@keystone.service[81372]: spawned uWSGI worker 1 (pid: 81385, cores: 1) Sep 11 14:52:47.953406 dv-cinder-856971-1-smb devstack@keystone.service[81372]: spawned uWSGI worker 2 (pid: 81386, cores: 1) Sep 11 14:52:47.953406 dv-cinder-856971-1-smb devstack@keystone.service[81372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 14:52:52.208833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 14:52:52.208833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 11 14:52:52.209617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 14:52:52.209617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 11 14:52:52.209762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 14:52:52.209762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 11 14:52:52.210194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 14:52:52.210194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 11 14:52:52.259161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 14:52:52.259301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 14:52:52.259469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] command line args: [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 14:52:52.259664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 14:52:52.259744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 14:52:52.259861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 14:52:52.259954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ================================================================================ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 14:52:52.260059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] command line args: [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 14:52:52.260138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 14:52:52.260416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_dir = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ================================================================================ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 14:52:52.260602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_source = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] debug = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.260998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_dir = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_source = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] debug = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.261942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_config_append = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_dir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.262987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_config_append = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_dir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.263935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.264933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.265968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.266951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] publish_errors = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] publish_errors = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.267896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] standard_threads = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] standard_threads = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.268999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_journal = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_json = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_stderr = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_syslog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_journal = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.269955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_json = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.270041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_stderr = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.270118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.270190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_syslog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.270376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.270457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 14:52:52.270637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.270725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.270876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.270960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.271930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.272901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.273867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.274851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.275993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.276923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.277505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.277685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.277767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.277922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.278971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.279916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.280985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.281990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.282953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.283890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.284920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.285972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.286979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.287883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.288848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.289960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.290928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.291968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.292737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.293973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.294964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.295890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.external = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.296997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.external = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.password = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.297967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.token = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.password = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.token = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.298941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.299964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.300844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.301907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.302912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.303910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.304876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.305981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.306962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.307910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.308922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.309932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.310902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.311878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.312967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.313996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.314982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.315905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.316850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.317925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.318893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.319998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.320952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.321972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.322934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.323920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.324863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.325951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.326926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.327971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.328898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.329870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.330979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.331938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.332994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.333951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.334886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.335986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.336954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.337974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.338933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.339089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.339177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.339327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.339407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.340901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.341864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.342997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.343970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.344946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.345967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.346926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.347862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 14:52:52.348515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.348964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 14:52:52.349136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 14:52:52.379410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.379638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.379866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.382766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.383011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.383241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.388228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.391900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.416317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.416551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.418703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.418938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.470583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.471344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.518775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.518959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.519725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.519965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.674153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.674402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.674631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.674852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.674935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.675757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.676234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.698251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.698503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.698727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.699979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.700108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.700192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.700403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.700622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.700840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.711709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.712524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.725496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.725656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.725738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.725871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.725954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.726972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 14:52:52.743393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.743603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 14:52:52.743686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.743841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 14:52:52.743945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 14:52:52.744227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 14:52:52.744453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.744987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.745163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.745243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.745419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.755005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.755286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.755561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.755850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.756347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.756630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.756901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.757182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.763321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.764674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.766212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.766526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.766811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.767100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.767389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.767659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.767746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.767932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.768880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.769024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.769112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.769294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.769567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.769837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.770111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.770401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.792151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.793612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.793939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.794231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.795086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.795371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.798927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.799218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.799504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.800015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.800302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.800583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.806090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.806405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.807168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.807455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.812055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.812360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.812656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.812947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.813235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.813965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.814063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.814246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.814548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.814823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.815092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.829942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.830227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.831044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.831325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.834032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.835188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.837229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.837529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.838412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.838712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.842249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.843504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.845356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.846674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.848609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.848910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.849203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.849492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.849772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.849854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.850075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.850171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.850434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.850720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.851008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.851300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.865843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.866137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.866433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.866703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.867029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.867319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.867589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.867854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.874062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.875321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.875633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.876861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.877154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.877440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.878403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.878680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.880251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.880538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.880821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.881103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.881379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.881503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.881664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.881952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.882235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.882658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.892947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.893237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.893521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.893786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.893914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.894981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.895114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.895334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.895612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.910845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.911413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.913745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.914309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.916660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.917173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.918177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.918715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.919717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.920004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.920144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.920405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.920533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.920811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.927031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.927406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.928493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.928865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.931425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.931758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.931885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.932108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.932233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.932374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.932506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.932687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.940739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.941010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.941138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.941311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.941439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.941595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.948161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.948454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.948591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 14:52:52.948722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.948846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.949961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.950975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.951951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.952081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 14:52:52.986543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b5825799c0 pid: 81386 (default app) Sep 11 14:52:52.986695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b5825799c0 pid: 81385 (default app) Sep 11 14:52:52.989857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a63a7-20e0-4aad-a3de-0c1ba5ab1449 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:52:52.990142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a63a7-20e0-4aad-a3de-0c1ba5ab1449 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:52:52.990442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a63a7-20e0-4aad-a3de-0c1ba5ab1449 None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:52:52.994582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sun Sep 11 14:52:52 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:52:59.660608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:52:59.661121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:52:59.661121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:52:59.665487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:52:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:52:59.670918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:52:59.671499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:52:59.671499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:52:59.742365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: INFO dbcounter [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] Registered counter for database keystone Sep 11 14:52:59.762025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG oslo_db.sqlalchemy.engines [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 14:52:59.768178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writer thread running {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 14:52:59.943713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 14:52:59.944015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 14:53:00.002542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:00.004115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:00.127705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:52:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 14:53:00.582504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:00.651616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: INFO dbcounter [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] Registered counter for database keystone Sep 11 14:53:00.673420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 14:53:00.679760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writer thread running {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 14:53:00.811378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0ab16-0be3-4751-9dd7-8864c1959760 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:00.817261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:00.817877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:00.818153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:00.818455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:00.827023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:00.878721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 14:53:00.879003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c5dbe-2788-49cc-8817-7da4d43d3425 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:00.888675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 14:53:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 14:53:00.894689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:00.911794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36780522-8aa5-4bcd-96e1-ed1c2003f292 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:00.916150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:00.917253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:00.917554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:00.917822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] PATH_INFO: `/v3/projects/7334057aea374090aa685d1856ec911f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:00.919417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] RBAC: Authorizing `identity:get_project(project_id=7334057aea374090aa685d1856ec911f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:00.972862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 14:53:00.973200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b1768-cd0c-46f8-bab4-72ca5e82b700 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:00.977707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sun Sep 11 14:53:00 2022] GET /identity/v3/projects/7334057aea374090aa685d1856ec911f => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:03.086116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51a1b-9ec6-462d-8b82-3a03cf21c7b3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:03.086709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51a1b-9ec6-462d-8b82-3a03cf21c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:03.086709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51a1b-9ec6-462d-8b82-3a03cf21c7b3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:03.090791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:03.096261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:03.096677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:03.096803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:03.116944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:03.118495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:03.126737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 14:53:03.392373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51a1b-9ec6-462d-8b82-3a03cf21c7b3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:03.405016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51a1b-9ec6-462d-8b82-3a03cf21c7b3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:03.409177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:03.409780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:03.410060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:03.410359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:03.418568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:03.420341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c386abd-a84c-49bc-829d-cf427f22c9aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:03.429264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 14:53:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 14:53:03.434886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:03.443849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15a66-a045-489b-b6f4-3d84d88cdc63 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:03.448216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:03.448838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:03.449115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:03.449387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:03.450726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:03.452540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace5f0-f75e-4d58-8460-2e0a6f759b6e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:03.454039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sun Sep 11 14:53:03 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:05.670196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c150-1e96-472b-86e7-e00d1b27db90 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:05.670761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c150-1e96-472b-86e7-e00d1b27db90 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:05.670761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c150-1e96-472b-86e7-e00d1b27db90 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:05.672086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:05.677545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:05.677954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:05.678098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:05.696588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:05.697759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:05.702209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b3f7-3e7d-4c9e-a26e-a50c6960db21 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:05.702609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b3f7-3e7d-4c9e-a26e-a50c6960db21 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:05.702891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b3f7-3e7d-4c9e-a26e-a50c6960db21 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:05.704270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:05.709399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:05.709679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:05.709950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:05.752415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 14:53:05.752795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 14:53:05.793438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:05.801923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:05.803579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:05.902551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:06.062117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.086601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.164233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7d948-9110-463f-b5b1-8499935d632b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.170589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.198320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.198985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.199263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.199537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.210336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:06.219137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:06.220012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:06.220852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:53:06.226035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.268903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0e0e-6893-4b29-802e-386056bc08b1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.271162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.305690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.306554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.307565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.307851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.308198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.324266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d383d5f-4932-4fe9-9f99-39b5fa267de8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.356708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.357304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.357577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.357841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.358526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:06.358823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.360198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.372729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:06.373992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.375536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.378369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.473168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:53:06.475204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff47f-ee78-4936-824c-e374eff90c7f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.478827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.482404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.509094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.509727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.510006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.510289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.511540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.512992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.514593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:06.519741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.535636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.575832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b525d4-15c3-48c2-8f7f-ca7f0277f6a4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.609551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.610428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.610712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.610980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.618049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cfea-62a9-47e3-9305-cbff5670e5b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.628788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.630246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:53:06.648123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:06.649141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:53:06.650157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:53:06.650157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:53:06.650157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:06.650157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:53:06.652508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.653138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.653412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.653682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.654834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.655519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.656279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.657804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:06.663455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:06.711582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.743962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:06.757693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895196c-d7aa-4e3b-9531-cbe64b63a95a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.764972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4f504-5b06-4547-96ab-9d3f8bda1582 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:06.791256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.791856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.792129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.792440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.793076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:06.793365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.794778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916e8cd-040b-4949-b544-1f5a67b5fc3c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.798112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:06.799174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:06.799455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:06.799729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:06.800446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.domain.id=default, user.id=9abde477b352443096596e97b4877ff3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:06.800752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:06.802452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb22754-8bfd-498d-b652-e7eb2ac37af7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:06.809009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/role_assignments?user.id=9abde477b352443096596e97b4877ff3&scope.domain.id=default&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:06.811924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:09.270003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a632f7-6668-48f3-ac32-56d8399e1110 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.270508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a632f7-6668-48f3-ac32-56d8399e1110 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.270508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a632f7-6668-48f3-ac32-56d8399e1110 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.271815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:09.278017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c167-72e3-4be9-9081-b4ef326c8890 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.278523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c167-72e3-4be9-9081-b4ef326c8890 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.278598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c167-72e3-4be9-9081-b4ef326c8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.303238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d571c167-72e3-4be9-9081-b4ef326c8890 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:09.304464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d571c167-72e3-4be9-9081-b4ef326c8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:09.390192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:09.630952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5018-d562-4e59-9171-8b9bb919c7ec None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.631147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5018-d562-4e59-9171-8b9bb919c7ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.631410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5018-d562-4e59-9171-8b9bb919c7ec None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.632924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:09.639211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb8d-7b41-4c8a-825a-166a4c5a6208 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.639567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb8d-7b41-4c8a-825a-166a4c5a6208 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.639851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb8d-7b41-4c8a-825a-166a4c5a6208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.665790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-902ddb8d-7b41-4c8a-825a-166a4c5a6208 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:09.667029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-902ddb8d-7b41-4c8a-825a-166a4c5a6208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:09.721423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:09.752277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:09.815234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787dd57-612c-4da2-bbac-2dd4e61ad8b9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.815559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787dd57-612c-4da2-bbac-2dd4e61ad8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.815792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787dd57-612c-4da2-bbac-2dd4e61ad8b9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.817398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:09.822892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.823184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.823971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.840321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4bb3-eaae-4431-9f24-d687201fc0b7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.840611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4bb3-eaae-4431-9f24-d687201fc0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.840877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4bb3-eaae-4431-9f24-d687201fc0b7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.842654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 15/27] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:09.847268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:09.847382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:09.847542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:09.847819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:09.848521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:09.885709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:09.887424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:09.965614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:09.975845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.038719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:10.102242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.119307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b203d-c16c-4a0e-913d-c533aab58f74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.128156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:10.158996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.159958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.160459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.160929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.174080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:10.182303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:10.183194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:10.183936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:10.186169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:10.192498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.254493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:10.296437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3e78-6ccf-423a-bf73-060fe8af0ad3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.310309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c9c4b-1576-46ea-8dac-547aa5b37b8d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.348495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.349472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.349968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.350591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.351679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:10.352258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:10.353850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:10.357565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.358180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.358511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.358992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.359431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:10.360815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:10.368442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:10.374677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.454406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:10.528448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b761b-8446-4aec-aea1-74f95636accc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.537739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 17/32] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 14:53:10 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:53:10.543773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.567292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.569346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.569346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.569346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.570735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:10.572738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:10.575204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:10 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:10.576232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.686675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:10.693161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab0a9-c34f-4bcf-bd38-cbf453df5110 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.755504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c0458-24c6-4b07-b84c-b8af25eb01ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:10.759004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.759755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.760129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.760495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.761322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:10.762841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:10.813194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:10.814985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:10.815467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:10.822410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:10.838656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:10.841698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:10.843621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:53:10.863633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:10.864534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:53:10.865353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:53:10.865353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:53:10.865353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:10.865353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:10.865680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:10.953199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 14:53:10 2022] POST /identity/v3/roles => generated 225 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:10.956235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:11.002665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dab1-97d6-4ac9-a2b6-c6e78e2148a8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.048599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.049219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.050007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.050305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.052006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.053675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819177-ef87-4d3e-932f-b620eda65efc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.056209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:11.062652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13f90-ca4e-4ddf-ba22-1e6b93a5cebb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.062960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13f90-ca4e-4ddf-ba22-1e6b93a5cebb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.063211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13f90-ca4e-4ddf-ba22-1e6b93a5cebb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.064588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 20/37] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:11.069541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc13f90-ca4e-4ddf-ba22-1e6b93a5cebb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:11.097462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce28d9-3069-49cf-80f7-e4af0de39e31 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.140294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:11.152530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.154097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.154577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.154992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.156093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:11.156555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.159140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac188d2-1b05-4672-80bd-94e52a54bd6f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.174667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:11.177327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2e88-2f00-48a7-8590-c8e084a36f3f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.177622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2e88-2f00-48a7-8590-c8e084a36f3f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.177903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa2e88-2f00-48a7-8590-c8e084a36f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.201520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-30aa2e88-2f00-48a7-8590-c8e084a36f3f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:11.203405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-30aa2e88-2f00-48a7-8590-c8e084a36f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:11.204831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc13f90-ca4e-4ddf-ba22-1e6b93a5cebb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.217927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:11.250355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.251322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.251804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.252090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] PATH_INFO: `/v3/domains/default/users/9abde477b352443096596e97b4877ff3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.254181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9abde477b352443096596e97b4877ff3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.255673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.271368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1361 bytes} [Sun Sep 11 14:53:11 2022] PUT /identity/v3/domains/default/users/9abde477b352443096596e97b4877ff3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:11.272189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:11.311961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:11.320964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f60a0-8617-4114-8d59-b671bb4633fa None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.321419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f60a0-8617-4114-8d59-b671bb4633fa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.321817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f60a0-8617-4114-8d59-b671bb4633fa None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.324527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:11.330092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.330802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.331184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.356936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:11.358573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:11.400856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f35ffe-ad61-4458-a0b7-6a74c64b0b98 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.421138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:11.446759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.447623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.448059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.449006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.449499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:11.449884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.459475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.494330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:53:11 2022] POST /identity/v3/projects => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:11.585789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:11.672859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:11.699040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ef3d7-2877-4750-a73d-df88aecbab2b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.729500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:11.736626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.737247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.737525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.737797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.738495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.739905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.757401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 14:53:11 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:11.859067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a407a5-af28-49b8-b114-06ce2d13b81c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:11.895691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:11.896335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:11.896611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:11.896877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:11.897992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:11.899506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e3266-bfb6-4f60-88da-04a9efbe954d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:11.901342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:11.907503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:12.014411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846797-0de8-41ba-ac66-078cb23543c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:12.047371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:12.047984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:12.048262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:12.048535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:12.049176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:12.050649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e92a-470a-4c00-b97b-f42582e177c0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:12.056586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:12.079803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:53:11 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:13.501901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac00ef-8106-4d11-85f7-0491ab37fc6f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:13.502453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac00ef-8106-4d11-85f7-0491ab37fc6f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:13.502560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac00ef-8106-4d11-85f7-0491ab37fc6f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:13.504675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:13.510454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:13.511553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:13.511923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:13.531890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:13.533077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:13.598420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:13.864270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac00ef-8106-4d11-85f7-0491ab37fc6f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:13.897841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:13.967285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac00ef-8106-4d11-85f7-0491ab37fc6f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.112420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.113072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.113352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.113626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.124881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f4c3a938-ce6d-44b0-8bd0-2cbf32be9585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:14.130065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:14.131081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:14.131854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:14.136978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.210438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ef1b-2a63-4c35-9b59-79016d0d1754 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.210717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ef1b-2a63-4c35-9b59-79016d0d1754 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.210991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ef1b-2a63-4c35-9b59-79016d0d1754 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.212385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 26/50] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:14.219025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.219317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.219592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.238844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:14.240447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:14.309030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 27/51] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:14.338351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a89236-b4b9-4d42-84ab-2bb9b899fb41 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.355870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:14.373887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.374519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.374805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.375125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.375749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:14.376055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.377442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.385357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:14.391520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.415845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:14.490768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117a81-acaa-49d0-8ea4-1adfeb713d30 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.523086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.523709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.523985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.524255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.525358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.527394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.529007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:14 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:14.534411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.574176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.631045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7643785-9e16-4d2b-8a8c-25a36a4842cf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.663106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:14.664329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.664956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.665237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.665509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.666642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.668118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.669825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:14.672757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5416a-e9c0-4bfb-a539-15f654790a00 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.675356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.705954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.706608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.706885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.707153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.708257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.709707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.711279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:14.717095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:14.723346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:14.777027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284326c-67f4-4394-969a-70d4d24e77a1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.809761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.810387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.810668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.810946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.811663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.domain.id=default, user.id=9abde477b352443096596e97b4877ff3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:14.811973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.813419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04948ef-9eeb-4e6b-9c22-5a28f4724acb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.815167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2abfb-d88e-4fb0-aa4d-7f28464c576e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:14.822068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 27/56] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 14:53:14 2022] GET /identity/v3/role_assignments?user.id=9abde477b352443096596e97b4877ff3&scope.domain.id=default&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:14.850704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:14.851135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:14.851412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:14.851681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:14.852340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:14.853839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81cce-cb0b-4a18-a83e-270feced36b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:14.883998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 30/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 14:53:14 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:53:17.050237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a87f96-5b5b-4400-8162-e10210c2f85f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:17.050722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a87f96-5b5b-4400-8162-e10210c2f85f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:17.050800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a87f96-5b5b-4400-8162-e10210c2f85f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:17.052396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:17.057484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:17.058397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:17.058580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:17.076835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:17.078011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:17.085133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:17.144330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:17.411830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a87f96-5b5b-4400-8162-e10210c2f85f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:17.511735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a87f96-5b5b-4400-8162-e10210c2f85f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:17.524112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:17.544874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:17.545497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:17.545780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:17.546056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:17.547200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:17.548645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3cf3a-16ae-4ccd-b97a-dadcfa707222 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:17.550169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:17.555881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:17.649684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caafc12-1d94-4fea-8458-f184c35536c6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:17.681424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be790682-45d0-47c0-b609-190c673de48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:17.681954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790682-45d0-47c0-b609-190c673de48e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:17.682230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790682-45d0-47c0-b609-190c673de48e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:17.682527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790682-45d0-47c0-b609-190c673de48e None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:17.683695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be790682-45d0-47c0-b609-190c673de48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:17.685136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be790682-45d0-47c0-b609-190c673de48e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:17.705330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:17.711279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:17 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:21.077723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794888-a52a-446a-84f8-878d423ceddd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.078221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794888-a52a-446a-84f8-878d423ceddd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.078363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794888-a52a-446a-84f8-878d423ceddd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.079670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:21.085152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203404-7fc5-4b3f-9195-cb5f757bb7ae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.085550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203404-7fc5-4b3f-9195-cb5f757bb7ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.085711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203404-7fc5-4b3f-9195-cb5f757bb7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.116043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ed203404-7fc5-4b3f-9195-cb5f757bb7ae None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:21.117242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed203404-7fc5-4b3f-9195-cb5f757bb7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:21.215414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:21.290854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597e18-bc38-418b-8df7-83890fba7bd3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.291131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597e18-bc38-418b-8df7-83890fba7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.291339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c597e18-bc38-418b-8df7-83890fba7bd3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.293219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 31/64] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:21.298360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1cd1-238e-4ac6-816d-34a2a57ef24b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.298655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1cd1-238e-4ac6-816d-34a2a57ef24b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.298934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1cd1-238e-4ac6-816d-34a2a57ef24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.323447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a4ed1cd1-238e-4ac6-816d-34a2a57ef24b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:21.324680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a4ed1cd1-238e-4ac6-816d-34a2a57ef24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:21.416947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:21.428230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc76c-92e7-4c69-9da8-ccd48eec107c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.428518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc76c-92e7-4c69-9da8-ccd48eec107c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.428798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc76c-92e7-4c69-9da8-ccd48eec107c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.430148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 32/66] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:21.441348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.441642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.441922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.471991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90fd4-32ca-4a0c-b564-c198582606a7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.472301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90fd4-32ca-4a0c-b564-c198582606a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.472550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90fd4-32ca-4a0c-b564-c198582606a7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.474038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 33/67] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:21.474731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:21.475936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:21.484621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.484621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.484621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.505270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:21.506916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:21.534804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:21.549510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 35/68] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:21.551030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:21.592764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:21.673697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d654aa-082e-4c2b-a8bc-451dfb4432c9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:21.687405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:21.717822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:21.719225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.719706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.720442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.734608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-704a1f83-80e6-41ea-9dd8-8f5dbfecbc91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:21.740448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:21.741296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:21.742026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:21.743685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:21.746153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685f3e-443c-4aab-803a-087c06aa0c5f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.746467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685f3e-443c-4aab-803a-087c06aa0c5f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.746742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685f3e-443c-4aab-803a-087c06aa0c5f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.750317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 37/71] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:21.751275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685f3e-443c-4aab-803a-087c06aa0c5f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:21.812614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b026f-20b1-409e-9c65-bb0e72bf2830 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:21.814717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:21.838723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:21.861170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:21.862071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.862377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.862649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.876240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:21.877583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685f3e-443c-4aab-803a-087c06aa0c5f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6453ce9c-1a31-4aa6-afef-d7f05320d6a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:21.882790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:21.883635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:21.884373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:21.886170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.890333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.890333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.906521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:21.907724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:21.915076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:21.915684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:21.915959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:21.916228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:21.916912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:21.917214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:21.918630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:21.926829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 38/73] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:21.927661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:21.981917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 36/74] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:21.987184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.028458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cfc4-8be1-46b7-94c5-9e7d6f0a9e7e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.039391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.065920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.066574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.066903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.067174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.077829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:22.083063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:22.083897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:22.084787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:22.090097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.096370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.099314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca465ab-dcf7-41e8-96f0-24abc00ad853 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.137074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.137689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.137980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.138381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.139158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:22.139471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.140847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.150229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.151063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.197251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e86c0-d4ed-4ee8-9bfe-71f9b940a2f4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.238215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.239166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.239843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.240133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.252479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:22.254912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29687f17-af2f-4b7b-b54f-d17590eafa8e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:22.257772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:22.258692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:22.259471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 40/77] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:22.260100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.289936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.291747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.292407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.292699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.292972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.294127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.295616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.297187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 38/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.302083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.329588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.360344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef3c26-68dc-4d19-a7d2-c266a9d34155 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.393811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.394453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.394739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.395026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.395680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:22.395986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.397384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.400585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c9f9-7f82-4b0d-b569-7fad13695fac None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.406121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.406947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.434559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.435191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.435470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.435742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.451076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.452518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.454101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 39/80] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.454890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.502466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.512093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67237b7-54d6-415e-a09f-ce36bb25cc21 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.539900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.545979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.546640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.546918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.547186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.548306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.549748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.551832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.552392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.553125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1228e9-944c-4f01-b204-f7d54204b493 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.588878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.589415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.589697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.589975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.590675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:22.590983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.592341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.600190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.600967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.651865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796445b-3447-4ea8-8ad1-1782399e0019 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.685471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.686074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.686389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.686659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.697841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af102bc-a664-4523-9fc9-ad497bddda8f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.712968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.730546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.731180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.731451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.731726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.732850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.734317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.735871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:22.736617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.753099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.754583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.756697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.836157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630be4f-5c77-408e-88b0-a1b471b2eb8f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.850728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:22.851476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:22.872197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.872805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.873088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.873365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.908920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.941055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.942551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:22.949089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f611ea-e65c-4fe4-a173-a82a54e29885 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:22.959209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:22.984808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:22.985432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:22.985711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:22.985983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:22.986670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:22.988131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.010117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 44/85] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:22 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:23.010947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.049807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:23.051053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.128862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ca468-20a5-42fa-82f0-846cc3a0bbf8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.147175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.166234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44325a-e9f4-45d8-a7bf-4ef47d48394d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.169618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.170380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.170730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.171072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.172330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.173881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.179014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:23.180446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.186396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.209039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.209998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.209998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.210169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.293036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.294563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.317530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f5786-84a2-4515-9127-2baf33cb53c4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.359506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.360153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.360432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.361352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.363173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.364110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.366080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 46/88] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:23.366913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.411466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 43/89] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:23.413423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.435696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.441221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.513445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f210-1a73-46e0-8841-c39417c9c77a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.530801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee63d-895f-43a3-a466-ff62ad1cf09b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.560866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.561775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.562064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.562368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.564162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.565899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.567656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 47/90] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:23.568424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.568975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.569649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.569996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.570376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.649223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.650836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.670940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.713286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292381-f9f1-4e51-8f5a-36e8df34cdde None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.741681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:23.763220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:23.764351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:23.764825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:23.765261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:23.766156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=9abde477b352443096596e97b4877ff3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:23.766668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:23.766909 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 44/91] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:23.767967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.768743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:23.774907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/role_assignments?user.id=9abde477b352443096596e97b4877ff3&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:23.776885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:23.967005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17c55-82f1-48ae-a6ee-0f527dee65a4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:23.987799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6eb10-e1eb-466b-a9fa-829ff3cea4dc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:24.020778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:24.032900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:24.033633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:24.033900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:24.034178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:24.034939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:24.035266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:24.036797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:24.046573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:24.046573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:24.071120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:24.071786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:24.072070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:24.072346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] PATH_INFO: `/v3/projects/5d867107062145dcbd841855f6f54bf8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:24.075368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] RBAC: Authorizing `identity:get_project(project_id=5d867107062145dcbd841855f6f54bf8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:24.077153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:24.086996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 45/94] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:23 2022] GET /identity/v3/projects/5d867107062145dcbd841855f6f54bf8 => generated 312 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:24.093913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:24.122677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:24.169161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288ff4-0910-4917-8246-6d0482fcfa8e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:24.239180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:24.239758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:24.240045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:24.240329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:24.241548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:24.243053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:24.245133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 50/95] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:24 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:24.250982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:24.316662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86a98-5d10-446f-af6f-e33301f35787 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:24.396713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:24.396713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:24.397271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:24.397782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:24.398767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=5d867107062145dcbd841855f6f54bf8, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:24.399273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:24.400945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d128-8435-407c-8a7f-fdd1112d8419 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:24.408175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:24 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=5d867107062145dcbd841855f6f54bf8&role.id=44a03d54df6f4580a9f4933398e65018 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:24.443002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad0b07-adc6-4c3f-956e-c05f621a6085 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:24.465124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:24.491205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:24.492192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:24.492762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:24.493224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:24.494260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:24.494854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:24.497167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be497925-3862-4638-8afa-65d2ec5e4bb1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:24.503947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:24 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=44a03d54df6f4580a9f4933398e65018 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:25.932294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b1c07-c788-453d-8860-6f93681944a2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:25.933335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b1c07-c788-453d-8860-6f93681944a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:25.933408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b1c07-c788-453d-8860-6f93681944a2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:25.935042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:25.943500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31f439-5cae-4011-840f-0ae71474213e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:25.943500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31f439-5cae-4011-840f-0ae71474213e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:25.943500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31f439-5cae-4011-840f-0ae71474213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:25.971318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4f31f439-5cae-4011-840f-0ae71474213e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:25.983345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f31f439-5cae-4011-840f-0ae71474213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:26.116515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 52/99] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:26.310411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45910-2ecb-4f13-be30-39d3c3408c94 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:26.311045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45910-2ecb-4f13-be30-39d3c3408c94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:26.311539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45910-2ecb-4f13-be30-39d3c3408c94 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:26.313087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 48/100] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:26.318641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:26.319141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:26.319606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:26.343869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:26.345329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:26.426280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 53/101] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:26.600597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45910-2ecb-4f13-be30-39d3c3408c94 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:26.666575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:26.737721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45910-2ecb-4f13-be30-39d3c3408c94 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:26.777393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:26.778037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:26.778340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:26.778620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:26.789428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:26.795004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:26.795805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:26.796545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:26.802427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:26.853999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:26.892926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:26.967353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f6e6-d573-404a-98d4-d6390ad5cd12 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.052476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2a5b2-8260-432d-9f9e-7a5f4a314702 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.064213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.084255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.085252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.085722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.086184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.087061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:27.087578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:27.089191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:27.089292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.089935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.090219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.090529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537e971-5de8-479d-8598-f1cc3e2a743f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 50/103] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878cbff-2ea9-45a0-964b-168ced32c5a2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878cbff-2ea9-45a0-964b-168ced32c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.098301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878cbff-2ea9-45a0-964b-168ced32c5a2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.101858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 51/104] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:27.106365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.106365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.106365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.112723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:27.113776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:27.129300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:27.130555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:27.202458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 52/106] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:27.207210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:27.324886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f051f2a-a912-4c62-806e-fc82d71f9520 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.327735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36ccb-38f0-472d-af50-db9149cca1b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.329776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.338377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.366851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.367709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.368130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.368540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] PATH_INFO: `/v3/users/448badba3bdd4d9888ed1bbe126bd8ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.384618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] RBAC: Authorizing `identity:get_user(user_id=448badba3bdd4d9888ed1bbe126bd8ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:27.386625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:27.392441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 53/107] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:27 2022] GET /identity/v3/users/448badba3bdd4d9888ed1bbe126bd8ee => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:27.394869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:27.407242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.408042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.408422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.409323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.409688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:27.411462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c850aa-3caa-47cb-b58c-871b0b32b296 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:27.466278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 55/108] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:53:27 2022] POST /identity/v3/projects => generated 302 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:27.511761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d709-4a0a-45a5-af10-f18668e6ffc3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.551208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.552386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.552809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.553219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.562918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643a0b-f6fc-401d-a1c5-aada8e3c8425 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.563346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643a0b-f6fc-401d-a1c5-aada8e3c8425 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.563715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643a0b-f6fc-401d-a1c5-aada8e3c8425 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.565535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 56/109] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:27.571235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdb53-1633-4881-a1c3-18e386d85e06 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.571535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdb53-1633-4881-a1c3-18e386d85e06 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.571916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdb53-1633-4881-a1c3-18e386d85e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.596071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.619586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-769cdb53-1633-4881-a1c3-18e386d85e06 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:27.621394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-769cdb53-1633-4881-a1c3-18e386d85e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:27.637220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:27.639120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3632036-89ae-4164-84e6-420436b82d54 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:27.733720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:27.735480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a6cb-122f-4ab8-a589-2148fd08cc6c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.736133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a6cb-122f-4ab8-a589-2148fd08cc6c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.736496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a6cb-122f-4ab8-a589-2148fd08cc6c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.738524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 58/111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:27.739854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695a6cb-122f-4ab8-a589-2148fd08cc6c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:27.763165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 54/112] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:27.763770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.764687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.764687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.782849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:27.784076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:27.836280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.856071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695a6cb-122f-4ab8-a589-2148fd08cc6c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:27.856990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:27.865652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:27.866222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:27.910366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:27.910559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:27.910763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:27.911029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:27.924039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:27.929365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:27.930218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:27.930999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 59/114] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:27.936928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.052759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7882fa-72f1-4e8d-960b-a005c2a8732b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.117819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.118500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.118784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.119062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.120730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.122192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.124009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 56/115] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:27 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.132179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.132787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491f1f-f67a-4fd1-b42c-ec8f8cd54b6a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.181736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.182292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.183120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.183394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.184062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:28.184366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.185752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee1344-3d5a-408d-8772-09f51265b5f3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.194222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 60/116] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.195462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683503de-7871-4461-854e-c94a08e79bae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.195747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683503de-7871-4461-854e-c94a08e79bae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.196023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683503de-7871-4461-854e-c94a08e79bae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.197240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 61/117] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:28.197938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683503de-7871-4461-854e-c94a08e79bae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.212623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.221041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.268125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238e07-a461-402c-b6e3-9593ef6c9b8d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.306729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.308087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.308814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.309086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.309804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=448badba3bdd4d9888ed1bbe126bd8ee) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:28.310114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.311575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.317842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/role_assignments?user.id=448badba3bdd4d9888ed1bbe126bd8ee&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=19fc242c01f345b588d2a42b922c6144 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.318671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.328342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683503de-7871-4461-854e-c94a08e79bae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.368156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.368817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.369098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.369381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.382320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5f78509b-d60a-4941-bf65-21dc868640f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:28.388813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:28.389761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:28.390563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 62/119] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:28.391343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3660-6224-4948-8665-4483344671cc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.391523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3660-6224-4948-8665-4483344671cc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.391781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3660-6224-4948-8665-4483344671cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.411828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-474e3660-6224-4948-8665-4483344671cc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:28.413094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-474e3660-6224-4948-8665-4483344671cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:28.459560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892335-496e-459a-8159-5ec0991cbc92 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.495002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.497246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.507286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.507508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 63/120] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:28.508302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.508796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.509204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.511165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.512782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.514881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.515396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e3660-6224-4948-8665-4483344671cc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.515955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.631262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e3660-6224-4948-8665-4483344671cc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.648307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a195f58-f33a-4334-9a6b-1b1bddbcc718 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.672742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.673628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.674045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.675055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.689412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.689746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:28.690024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.690324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.690598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.691252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:28.691555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.692927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:28.696335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:28.697358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:28.698920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:28.701610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:28.706298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.706639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.708687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.768905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.788350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:28.816739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4739c-640b-440c-b2a7-d384a79c5e5a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.842389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c8566-373b-4f8e-abab-5a32fcd861a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:28.853021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.853734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.854080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.854532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.855966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.857660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.859483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.860316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.885342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:28.886358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:28.886810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:28.887249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:28.888499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:28.888996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:28.891017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:28.902694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:28.906432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:28.986735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eeac7-e560-48ae-a670-541b906a2329 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.012489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.025883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.027025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.027320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.027602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.028848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.030553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.032384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:28 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:29.033090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.043722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c04c-a6c2-4547-9003-4f908b73fe7a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.069835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.087442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.088543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.089445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.089821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/users/9abde477b352443096596e97b4877ff3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.092334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, user_id=9abde477b352443096596e97b4877ff3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.093893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.113096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 61/127] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:28 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/users/9abde477b352443096596e97b4877ff3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:29.115007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.168850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c02edf-a700-4c2a-949c-17c8f370e7c5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.243484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.244475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.245032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.245467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.250590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e6ba5-90fb-429e-8793-b84ed3336aae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.251475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.253390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.255562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 67/128] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:29.256593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.300305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.300951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.301298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.301898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.315860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:29.323911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:29.324802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:29.325586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 62/129] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:29.326190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.353136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.381757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.407624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f954b-3c74-4148-86ca-50a4c7181711 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.475383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.476198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.477059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.478190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.480951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.482781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 68/130] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:29.483373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.500486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdc83-5138-464f-8e06-c076df59a49d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.576905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.577467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.577747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.578023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.579369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.580819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.591208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 63/131] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:29.592175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.626003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b14cb-2aed-4ff5-a55a-192905d3ac3d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.672784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.700482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.701696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.701802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.702023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.702895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:29.703308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.704677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.725819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 69/132] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:29.726867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.750478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffbf0-fbac-4e6a-a7a2-54d1eefecd60 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.762697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:29.790381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.791898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.792483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.792989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/users/2b3d5c3114f543a9baef9814c1ab6287/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.795235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, user_id=2b3d5c3114f543a9baef9814c1ab6287, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.796963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:29.827882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 64/133] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:29 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/users/2b3d5c3114f543a9baef9814c1ab6287/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:29.829071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:29.913971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c11f3f-9d58-4f4d-a187-30ccd5854c85 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:29.977796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:29.980174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:29.980706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:29.981194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/users/2b3d5c3114f543a9baef9814c1ab6287/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:29.992872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, user_id=2b3d5c3114f543a9baef9814c1ab6287, role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:29.994744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:30.021966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 70/134] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:29 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/users/2b3d5c3114f543a9baef9814c1ab6287/roles/dc8bbaa1778e437ab64402e812b88365 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:30.126887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1642-2860-4332-9b14-d65da1bd6ff8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:30.176870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:30.177536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:30.177820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:30.178098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:30.179381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:30.180900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc331604-b70a-4158-b5ec-b5ba33011ee2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:30.183203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 65/135] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:29 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:30.189742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:30.261380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:30.329032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558975b-520d-4046-a6de-26f1a1523f12 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:30.368020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:30.368733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:30.369012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:30.369282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] PATH_INFO: `/v3/projects/5d867107062145dcbd841855f6f54bf8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:30.370961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=5d867107062145dcbd841855f6f54bf8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:30.372431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:30.374131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 71/136] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:30 2022] GET /identity/v3/projects/5d867107062145dcbd841855f6f54bf8 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:30.380297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313f9c-6570-4a9d-a4fb-35153ae8c7dd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:30.380522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313f9c-6570-4a9d-a4fb-35153ae8c7dd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:30.380785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313f9c-6570-4a9d-a4fb-35153ae8c7dd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:30.382134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 66/137] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:30.383066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:30.393121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:30.393402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:30.393682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:30.425722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:30.428194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:30.481483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:30.546095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247acfb9-73f7-459a-a887-114eaaa3a0d7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:30.547563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 67/138] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:30.577148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:30.593513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:30.594181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:30.594487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:30.594758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] PATH_INFO: `/v3/projects/5d867107062145dcbd841855f6f54bf8/users/2b3d5c3114f543a9baef9814c1ab6287/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:30.596692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] RBAC: Authorizing `identity:create_grant(project_id=5d867107062145dcbd841855f6f54bf8, user_id=2b3d5c3114f543a9baef9814c1ab6287, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:30.598224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:30.617832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:30 2022] PUT /identity/v3/projects/5d867107062145dcbd841855f6f54bf8/users/2b3d5c3114f543a9baef9814c1ab6287/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:31.011445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:31.133813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb91eb-8c47-4e76-ae3b-115f0d7bd8d0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:31.174481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:31.175237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:31.175519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:31.175794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:31.177295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:31.178812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85961c91-c94b-439d-bd5c-ca058159835d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:31.180485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:31.187130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:31.226230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e787a-e452-446c-a5e1-3b833b9469a4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:31.226607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e787a-e452-446c-a5e1-3b833b9469a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:31.226813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e787a-e452-446c-a5e1-3b833b9469a4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:31.228279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 69/141] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:31.237971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:31.238252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:31.238552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:31.263719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:31.264913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:31.304030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:31.347206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:31.366024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323472ee-3bee-4281-8896-7b741e6825ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:31.416281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:31.417287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:31.417753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:31.418160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:31.419033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:31.420676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:31.453731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 73/143] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:31 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:31.737365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:31.850829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04f705-3b07-400c-bfaf-c397b274ae67 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:31.884902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:31.885632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:31.885913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:31.886186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:31.896176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:31.901574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:31.902453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:31.903211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:31.909848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:31.965125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:32.067446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b520-a7aa-422e-8849-0c24a3d72890 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:32.118051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:32.118695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.118970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.119237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.120432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:32.120730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:32.122108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:32.132771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:32.138685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:32.174671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:32.274485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c41b-7d0b-4d98-ab45-108c5fb1e922 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:32.317733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:32.318322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.318608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.318880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] PATH_INFO: `/v3/users/448badba3bdd4d9888ed1bbe126bd8ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.320017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] RBAC: Authorizing `identity:get_user(user_id=448badba3bdd4d9888ed1bbe126bd8ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:32.321462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2155-a9a4-41d4-ba3e-c367fac24a4b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:32.323581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:32 2022] GET /identity/v3/users/448badba3bdd4d9888ed1bbe126bd8ee => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:32.329401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:32.377888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd822-0b4c-4543-8116-02371f3c5940 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.378172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd822-0b4c-4543-8116-02371f3c5940 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.378490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd822-0b4c-4543-8116-02371f3c5940 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.380951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 73/147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:32.387125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59d3da-c505-4c9f-abb8-38840e49bb31 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.387776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59d3da-c505-4c9f-abb8-38840e49bb31 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.388064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59d3da-c505-4c9f-abb8-38840e49bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.420800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2e59d3da-c505-4c9f-abb8-38840e49bb31 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:32.421996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2e59d3da-c505-4c9f-abb8-38840e49bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:32.461148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82579-1113-4fc3-b8c7-addd16d37678 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:32.465751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:32.535249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:32.537036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.537316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.537586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.540490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:32.546029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:32.548020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 75/148] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:32 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:32.554159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:32.582126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:32.699957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136237b-da97-431d-acfc-787cc76bc3cd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:32.743145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:32.743882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.744156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.744423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/users/448badba3bdd4d9888ed1bbe126bd8ee/roles/19fc242c01f345b588d2a42b922c6144` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.746936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, user_id=448badba3bdd4d9888ed1bbe126bd8ee, role_id=19fc242c01f345b588d2a42b922c6144)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:32.748440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142cb5e-b492-4dee-ac23-66c034066c24 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:32.768265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:32 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/users/448badba3bdd4d9888ed1bbe126bd8ee/roles/19fc242c01f345b588d2a42b922c6144 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:53:32.843768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6763-fbd3-4e6f-b961-5900679cd3ee None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.844015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6763-fbd3-4e6f-b961-5900679cd3ee None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.844253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6763-fbd3-4e6f-b961-5900679cd3ee None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.845789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 75/151] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:32.851279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:32.851624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:32.851899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:32.879587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:32.880941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:32.905197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:32.979884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:33.031537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6763-fbd3-4e6f-b961-5900679cd3ee None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.060315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:33.167289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6763-fbd3-4e6f-b961-5900679cd3ee None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:33.209786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:33.210440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.210720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.210987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.224726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:33.230084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:33.231080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:33.231851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:33.233890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:33.240005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.385294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2be1a-55de-4ef2-a848-db8b12027cfd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:33.428397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:33.428942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.429221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.429491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.430169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:33.430540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:33.432000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f6cb-6743-4ea2-b19d-2ece952dd33a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:33.441892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:33.447375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.458505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f5da-0b8a-44c1-825c-823b2c0dd331 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.458768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f5da-0b8a-44c1-825c-823b2c0dd331 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.459045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f5da-0b8a-44c1-825c-823b2c0dd331 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.460579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 79/155] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:33.466069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.466818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.466818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.499410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:33.500781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:33.515309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:33.571563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:33.595383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba089b-5dae-4687-a808-c45b4db15bce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:33.612102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 80/156] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:33.612971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.644475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:33.645117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.645390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.645658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] PATH_INFO: `/v3/users/9abde477b352443096596e97b4877ff3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.650801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] RBAC: Authorizing `identity:get_user(user_id=9abde477b352443096596e97b4877ff3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:33.652797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:33.654441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/users/9abde477b352443096596e97b4877ff3 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:33.661717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.748112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c5c04-72bc-4fcc-81d6-b8a7dddc7342 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:33.797792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2270903-d63a-4dcd-a704-397f16ac7689 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:33.810087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:33.810766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.811038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.811299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.830879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:33.835739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:33.837155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:33.839327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 81/158] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:33.847267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:33.859017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:33.859970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:33.860465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:33.860941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:33.863283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:33.893635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.017303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.018740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.044145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7efd24-123a-40f7-8d4a-b34d4304ca2f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.111277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.112296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.112825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.113299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.114233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:34.114770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.116354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.126700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 82/159] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:34.128295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.198547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 78/160] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:53:34.199435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.255048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.266213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.321301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88d8a2-c240-43b8-a28b-1341e8e62c05 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.328608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b964-e75b-49d3-9d9a-02ae8bc0b197 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.377923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.378599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.379023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.379479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.381686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.383512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.383858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.384733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.385118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 79/161] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:34.385444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.385917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.386049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.406520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:34.412522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:34.413407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:34.414179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:34.416542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:34.418194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.552325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7769c7-b824-4ace-b35e-f30761e48a7f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.568952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68930312-f451-4c4c-bde2-a79f9817178f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.598675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.603057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.623077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.624144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.624722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.625241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.662984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.663632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.663907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.664173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.665336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.668654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.669261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:34.669794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.732041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.733996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.807156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e30a0-7b84-4f71-b03d-375eda8cfa99 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:34.852957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:34.853494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:34.858494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:34.858700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:34.859436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:34.859836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:34.861270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:34.880829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:34.881689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.926824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 84/165] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:34.927563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:34.989475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:34.990559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:35.118047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac4c9-29d4-4f9c-ad94-668194286734 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:35.150235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604529ee-47c6-45e3-9552-48d7c12193a6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:35.183590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:35.184119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.184399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.184672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.185503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=9abde477b352443096596e97b4877ff3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:35.185699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:35.187155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb6e5-b52d-44a5-a1ce-6e650a0ed48c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:35.193187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 82/166] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/role_assignments?user.id=9abde477b352443096596e97b4877ff3&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:35.194417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192ab-1894-4fff-9219-232b5329d57a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.194703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192ab-1894-4fff-9219-232b5329d57a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.194804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:35.194993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7192ab-1894-4fff-9219-232b5329d57a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.195373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.195654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.195930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.196306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 83/167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:35.196886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7192ab-1894-4fff-9219-232b5329d57a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:35.199173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:35.200678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13584270-8aa0-4347-bb35-8d0c40deb45c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:35.207121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:34 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:35.208485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.208775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.209049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.242610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:35.243820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:35.362712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7192ab-1894-4fff-9219-232b5329d57a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:35.389849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:35.448625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:35.449287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.449557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.449824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.451016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:35.452512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:35.454433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 84/169] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:35 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:35.461087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:35.470042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:35.471015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:35.531388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:35.690164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e6ad3-1e97-409a-867b-373222deb761 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:35.711275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e58ee-8b13-4adb-bff1-ede5fea6a2ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:35.760460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:35.761076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.761354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.761626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.762390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:35.762702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:35.764148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:35.780826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 87/171] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:35 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=44a03d54df6f4580a9f4933398e65018 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:35.794071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:35.794733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:35.795015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:35.795287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:35.888772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:35.917943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:35.919469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:36.059355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 85/172] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:36.065318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:36.233675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:36.246430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:36.249824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22fbd-7dc7-48a2-9ec7-c319b00ba9ea None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:36.342998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:36.343651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.343937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.344214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.345412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:36.346890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308143ae-d111-4e0e-b9ff-543dd9d9a2df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:36.348521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 88/173] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:36 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:36.349692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e8ce-6059-4ef4-86e2-a6284d290c3a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.349981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e8ce-6059-4ef4-86e2-a6284d290c3a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.350255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e8ce-6059-4ef4-86e2-a6284d290c3a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.351596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 89/174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:36.355674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e8ce-6059-4ef4-86e2-a6284d290c3a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:36.388517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:36.414033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a9600-9000-403e-a61d-20af1a7a42bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:36.489925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:36.490546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.490824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.491088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.516342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-18589be6-3d40-407c-ac32-d61ac20fa15b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:36.522764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:36.523602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:36.524373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:36.525413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:36.532157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.532438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.532712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.563731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:36.565055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:36.568539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e8ce-6059-4ef4-86e2-a6284d290c3a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:36.635158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:36.636300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.636773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.637330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.638260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:36.638820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:36.640652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:36.649704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 87/176] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:36.652259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:36.656359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 90/177] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:36 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:36.731698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:36.765970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c225d-a545-4ce4-a1d4-6e94cd03f6dc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:36.804999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:36.805639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:36.805916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:36.806189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:36.806923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:36.807330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:36.808700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c7fad-c6fd-41e3-937e-36d84752b21c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:36.818941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 88/178] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:36.825338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:36.861671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:36.964783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad318-d243-4a2c-9330-c2fb5039bc29 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.004904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.005625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.005904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.006172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] PATH_INFO: `/v3/users/2b3d5c3114f543a9baef9814c1ab6287` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.007418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d5c3114f543a9baef9814c1ab6287)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.010985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fed0d-9e40-42fb-bed2-073a3f277895 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.011271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fed0d-9e40-42fb-bed2-073a3f277895 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.011528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fed0d-9e40-42fb-bed2-073a3f277895 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.013296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 89/179] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:37.013980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.016323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 91/180] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:36 2022] GET /identity/v3/users/2b3d5c3114f543a9baef9814c1ab6287 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.018648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27723a-27f7-4198-ae9a-44d711dbb72e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.019151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27723a-27f7-4198-ae9a-44d711dbb72e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.019634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27723a-27f7-4198-ae9a-44d711dbb72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.021702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.051424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a27723a-27f7-4198-ae9a-44d711dbb72e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:37.053077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a27723a-27f7-4198-ae9a-44d711dbb72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:37.133721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 90/181] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:37.135094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9407e-4c0d-49d7-8e0f-757008b4a965 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.135457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9407e-4c0d-49d7-8e0f-757008b4a965 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.136251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9407e-4c0d-49d7-8e0f-757008b4a965 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.137527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 91/182] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:37.138305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9407e-4c0d-49d7-8e0f-757008b4a965 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.155246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.165974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8b6d-73df-4b6e-86e4-83976fc04651 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.207249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.207858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.208146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.208397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.219492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.262585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9407e-4c0d-49d7-8e0f-757008b4a965 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.280495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.282338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c09ae4-829d-4afa-8620-30b80cc72c84 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.298949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.299592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.299852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.300122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.310940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3d86a1da-36a0-4087-9adc-d8f93d16c059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:37.316249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:37.317110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:37.317878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 92/183] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:37.318569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.318732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.319946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.338101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:37.339852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:37.388122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.399876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:53:37.401621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6db56-b773-4e38-9c79-0f6f4fdffca4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.401909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6db56-b773-4e38-9c79-0f6f4fdffca4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.402178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6db56-b773-4e38-9c79-0f6f4fdffca4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.405807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 93/185] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:37.405807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6db56-b773-4e38-9c79-0f6f4fdffca4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.419889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 93/186] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:37.420734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.477019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.517406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6db56-b773-4e38-9c79-0f6f4fdffca4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.525775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b375d1d-b30d-408b-8f50-bc9570b39e80 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.552634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.553421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.553705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.554058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.555406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:37.555721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.557843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e6293-ee4a-42bc-88a7-348b35875d7e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.562326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.563403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.563688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.563962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] PATH_INFO: `/v3/projects/5d867107062145dcbd841855f6f54bf8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.565221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d867107062145dcbd841855f6f54bf8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.566183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 94/187] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.567394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.567679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.567952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.571256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.573536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 94/188] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/projects/5d867107062145dcbd841855f6f54bf8 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.578823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.586516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:37.587716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:37.635983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.666303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 95/189] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:37.666303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.699416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3844ca1-0361-4608-ad1e-f93db7a221d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.719890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.735080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.735791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.736173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.736565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.747096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:37.752532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:37.753605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:37.754420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 95/190] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:37.755046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.780572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dea75-da61-448b-8f99-26861f0a7068 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.813305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.813854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.814122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.814423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.827381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.828819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.830439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.834972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.871182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15701a4-6944-45e5-8265-b6603cc6ee5e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.872510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.910427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.911231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.911653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.912061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.912900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=5d867107062145dcbd841855f6f54bf8, user.id=2b3d5c3114f543a9baef9814c1ab6287) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:37.913283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.914956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.929622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 96/192] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/role_assignments?user.id=2b3d5c3114f543a9baef9814c1ab6287&scope.project.id=5d867107062145dcbd841855f6f54bf8&role.id=44a03d54df6f4580a9f4933398e65018 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.929622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:37.939597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df33ef6-501f-4b28-a9b7-63f9245306b3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:37.983253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:37.988952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:37.989618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:37.989897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:37.990171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:37.992174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:37.993717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:37.998606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:37.998606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.047799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4be3-2078-4944-a048-7249c14d4e26 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.088309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.089361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.089663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.089935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.090733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:38.091035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.093147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.102296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:38.107406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.116003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a76e3-9f6e-404f-9a61-4c2682a9ebc6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.126082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.153272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.153888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.154168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.154462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.221908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f762f3-fdb7-41e0-b9e1-2cf89761d8ea None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.228631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.228767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.231150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.256074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.256704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.256977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.257246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.266939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:38.272064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:38.273106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 98/195] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:38.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.330850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 98/196] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:38.332755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.342351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.375321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100606b-754f-43ce-a74f-1829ab1b5eab None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.408318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.408921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.409201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.409473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.410126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.411591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.428225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e7ebd-5fd8-446e-a103-077fa1c228a4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.439289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 99/197] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:38 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:38.447528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.471547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.472194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.472472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.472743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] PATH_INFO: `/v3/users/448badba3bdd4d9888ed1bbe126bd8ee` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.473958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] RBAC: Authorizing `identity:get_user(user_id=448badba3bdd4d9888ed1bbe126bd8ee)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.475556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.477476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 99/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/users/448badba3bdd4d9888ed1bbe126bd8ee => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:38.477605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.478185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.565743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d267d2-4986-4c7d-9bd9-6582d4e532cc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.568787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.595183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008d59-eb7e-440e-a14d-0b1405a681fd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.606999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.607679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.607894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.608163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.608853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:38.609119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.610582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.620613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 100/199] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:38.621440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.641240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.641882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.642160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.642462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.643605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.645047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.647014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 100/200] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:38.647704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.725934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.752111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e90d54-5541-4f6f-a16c-0577ebe91b03 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.766841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f28eb-aa34-4fc6-bea2-a54d5ae9af1d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.792004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.793361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.793854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.794613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.813406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.814076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.814403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.814680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.817138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.819310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.820524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 101/201] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:38.821431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:38.838918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:38.889139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.891322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:38.944593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501873c1-dcd3-4d7f-9358-b9acd04fdf94 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:38.990375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:38.991024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:38.994513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:38.995085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:38.996538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=e7d01c18cf204c36b8a65d030e314225) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:38.997048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:38.999191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.005856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:39.008862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/role_assignments?user.id=e7d01c18cf204c36b8a65d030e314225&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:39.011339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:39.046754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:39.054709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:39.115835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:39.168457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3ae4-0a03-449f-8589-0655ccb9bb3f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:39.245740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:39.246692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:39.247044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:39.247321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:39.258174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f06-59b1-4aa9-96a9-05a38a2db6ce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:39.295919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:39.296942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:39.297476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:39.297940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:39.299560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:39.301077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.303682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:39 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:39.312170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:39.323428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:39.325371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.412266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:39.435010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:39.460732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 103/205] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:39.467979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:39.508197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac3ac-4832-499d-b5ea-833078f63458 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:39.547780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:39.548392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:39.548671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:39.548945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:39.549682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, scope.project.id=82cd53828e69487a8918277ec483c67a, user.id=448badba3bdd4d9888ed1bbe126bd8ee) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:39.549993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:39.552173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.560123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 103/206] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:39 2022] GET /identity/v3/role_assignments?user.id=448badba3bdd4d9888ed1bbe126bd8ee&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=19fc242c01f345b588d2a42b922c6144 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:39.580506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db274f6-829a-45b2-8ba4-989bbeb2d4a6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:39.618143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:39.619104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:39.619539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:39.620484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:39.621898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:39.623575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4e1ed-6a6c-4661-b196-46f64c9907f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.625586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:39 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:39.632021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:39.781307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f0ca-08db-4187-842a-a6b731399dc7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:39.800702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:39.820920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:39.821527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:39.821806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:39.822075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:39.823454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=e7d01c18cf204c36b8a65d030e314225) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:39.823814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:39.825310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5821a-f39a-4d27-927d-f41404c12ae9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:39.831045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 104/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:39 2022] GET /identity/v3/role_assignments?user.id=e7d01c18cf204c36b8a65d030e314225&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:40.977755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac914-bb6b-45d4-a5eb-0197cea80b11 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:40.978583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac914-bb6b-45d4-a5eb-0197cea80b11 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:40.979134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac914-bb6b-45d4-a5eb-0197cea80b11 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:40.980966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:40.986719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:40.987534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:40.988008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.006927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:41.008418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:41.073494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea838d-e7b1-4907-9f70-d937f0a280ea None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.073803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea838d-e7b1-4907-9f70-d937f0a280ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.074043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea838d-e7b1-4907-9f70-d937f0a280ea None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.075705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 106/210] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:41.079824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:41.086310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642030-589c-46e8-88d5-464f272c0827 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.086310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642030-589c-46e8-88d5-464f272c0827 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.086310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642030-589c-46e8-88d5-464f272c0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.103628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63642030-589c-46e8-88d5-464f272c0827 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:41.105262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63642030-589c-46e8-88d5-464f272c0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:41.146597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:41.178369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:41.361202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:41.462539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e646-9b99-4ff4-b457-eed3e31d195e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:41.474055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:41.476932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63642030-589c-46e8-88d5-464f272c0827 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:41.507259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:41.508453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.509036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.509514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.522139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f22b599e-2ac0-4863-932b-5baf018f7cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:41.527171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:41.528248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:41.529635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:41.531472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d204-97bc-4990-a28c-8497b607cb8b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.531750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d204-97bc-4990-a28c-8497b607cb8b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.532042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d204-97bc-4990-a28c-8497b607cb8b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.533451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 107/214] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:41.533981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17d204-97bc-4990-a28c-8497b607cb8b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:41.592751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63642030-589c-46e8-88d5-464f272c0827 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:41.631385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:41.631939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.632213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.632477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.633555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:41.635029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd2f1e-6eca-4912-93cd-e4454ac10af9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:41.636857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:41.637787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.638040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.638321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.644868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17d204-97bc-4990-a28c-8497b607cb8b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:41.656849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:41.658029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:41.684216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:41.685180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.685640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.686090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.687159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:41.687471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:41.688894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:41.692541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:41.704201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:41.704201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:41.729234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 109/217] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:41.738473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:41.748516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:41.827055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e15c3-34b0-4b94-8968-fbe5253bc07f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:41.864976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7207-9dd9-45e0-9b11-1fdc7ac8e08d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:41.875153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:41.875782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.876064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.876338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.877476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:41.879774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:41.907533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:41.908569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:41.908975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:41.909519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] PATH_INFO: `/v3/users/aa09b598c3754eedab56d4f43d96f884` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:41.914370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 109/218] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:41 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:41.931285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] RBAC: Authorizing `identity:get_user(user_id=aa09b598c3754eedab56d4f43d96f884)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:41.933488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:41.935674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:41 2022] GET /identity/v3/users/aa09b598c3754eedab56d4f43d96f884 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:41.941821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.029464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.065322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.065852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.081619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5451a-8312-4bd2-9adc-9069e66176b8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.121388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.122005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.122310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.122573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.148211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a487750-9778-432e-8371-1eb12849d12c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.193614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.194505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.195666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.195666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.207646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-30e95de1-c3ed-4546-a3fe-4cf3f548374b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:42.212551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:42.214024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:42.214894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:53:42.215536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d35b-91a0-4a3e-8729-bcbdc6daf504 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.215536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d35b-91a0-4a3e-8729-bcbdc6daf504 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.216237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d35b-91a0-4a3e-8729-bcbdc6daf504 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.218315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 112/221] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:42.224449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.224818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.225160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.232031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.234506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.248773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:42.249982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:42.329917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 113/222] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:42.331262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.353617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.369366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.376789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 110/223] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:42.382341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.517832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a4575-71e9-49df-9fec-9285dd0da994 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.557345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6049d9-408c-463e-9413-12109bb4eae0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.577645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.578257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.578702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.578990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.579629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:42.579928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.581291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.590892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:42.596101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.610526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.611162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.611434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.611700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.612818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.614293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.617408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 111/225] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:42.621546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.702204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.724460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.745870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9716-a58c-482d-b1f0-364a6f82b51d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.754247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4692-95a3-4938-9cac-a1c9a685eb43 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.783407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.784346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.784770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.785173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.786581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.788256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.794747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 115/226] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:42.795326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.798982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.800309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.800309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.800309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.800961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=aa09b598c3754eedab56d4f43d96f884) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:42.801267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.803065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.809023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/role_assignments?user.id=aa09b598c3754eedab56d4f43d96f884&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=44a03d54df6f4580a9f4933398e65018 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:42.810123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.910117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00a3e-9ea6-498c-aca4-d91d4539b040 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.939145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d631be-0d43-48e7-acd8-f3c768655fa3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:42.951980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.953041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.953534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.953997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.963527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:42.969148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:42.974987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:42.975907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:42.976674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:42.980254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 116/228] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:42.981519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:42.982171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:42.982507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:42.982787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:42.983931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:42.985378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:42.991979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 113/229] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:42.993278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:42.993536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:43.018715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:43.122822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636bcde-530b-4d19-80cd-cdaefadac8cf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:43.169538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:43.170423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:43.170764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:43.171112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/e7d01c18cf204c36b8a65d030e314225/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:43.174034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, user_id=e7d01c18cf204c36b8a65d030e314225, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:43.176352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:43.193427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 114/230] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:42 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/e7d01c18cf204c36b8a65d030e314225/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:43.202801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb23b-3b42-4169-82b7-c0577435369c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:43.267124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:43.268114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:43.268629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:43.269126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:43.270034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:43.270575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:43.272422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:43.283158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:43.289022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:43.351947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:43.408348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056d5a6-efc5-4873-ab8c-f480c92e191f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:43.445137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:43.445787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:43.446066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:43.446368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:43.447657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:43.449130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:43.451369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:43 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:43.456499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:43.542046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:43.578649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ab7d-501c-4874-b6a1-3682934e6414 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:43.614359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:43.615176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:43.615458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:43.615730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:43.616855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:43.618335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5296387-f616-49ca-8b68-a7430cadfdb9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:43.620732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 118/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:43 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:43.626527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:43.731718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc827-4440-4802-b8b5-fe9568f17e64 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:43.758636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:43.767699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:43.768419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:43.768703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:43.769159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/e7d01c18cf204c36b8a65d030e314225/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:43.771381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, user_id=e7d01c18cf204c36b8a65d030e314225, role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:43.772836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066594f8-9ef7-40a8-ad1d-b689f7e0abea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:43.789092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:43 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/e7d01c18cf204c36b8a65d030e314225/roles/dc8bbaa1778e437ab64402e812b88365 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:44.630566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7db1-d326-41ae-8f9e-f56ac59f1e06 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:44.630566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7db1-d326-41ae-8f9e-f56ac59f1e06 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:44.630566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7db1-d326-41ae-8f9e-f56ac59f1e06 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:44.631646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 119/235] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:44.637612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:44.638430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:44.638933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:44.660782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:44.662288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:44.722293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b394-ddac-472f-805c-fbb741f242a4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:44.722293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b394-ddac-472f-805c-fbb741f242a4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:44.722293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b394-ddac-472f-805c-fbb741f242a4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:44.722293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 120/236] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:44.726294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:44.726581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:44.726853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:44.746023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 117/237] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:44.758288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:44.759724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:44.840299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:45.060168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.172269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cca13c-0996-4a10-a21a-8d404643c2bc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.180478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:45.210591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:45.211559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.212028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.212513 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.223123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:45.228172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:45.229577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:45.230368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:45.232558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:45.239570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.257957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.336388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:45.393386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fcc68-d114-4056-ab88-91077e552df6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.427133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3808d-c800-4b93-88f2-cb4cd3bea80d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.460056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:45.460669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.460950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.461223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.461892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:45.462199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:45.466850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:45.485049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:45.489464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:45.490104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.490426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.490704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.491769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.491874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:45.493264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:45.498320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:45.500663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.561700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:45.682547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c7f1a-b0d1-4e59-b026-3a36604f1893 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.683149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02897-60e8-4de5-8218-c9793d2fa87c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.715053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:45.721107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:45.722082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.722578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.723137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] PATH_INFO: `/v3/users/a69af953bcd14c09b858bb6d94ebdbe0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.725682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:45.727344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.727785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.728195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.729004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:45.730588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b77697-d38b-497e-8e99-b99b480b5b3e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:45.738649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] RBAC: Authorizing `identity:get_user(user_id=a69af953bcd14c09b858bb6d94ebdbe0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:45.740327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5255e-8f7e-49e0-a597-110b53ba9f77 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:45.742485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 123/242] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:45 2022] GET /identity/v3/users/a69af953bcd14c09b858bb6d94ebdbe0 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:45.743719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143382-14e6-4915-a9ac-89236f63222b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.744114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143382-14e6-4915-a9ac-89236f63222b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.745019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143382-14e6-4915-a9ac-89236f63222b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.747648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 124/243] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:45.751195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143382-14e6-4915-a9ac-89236f63222b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:45.758056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 120/244] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:45 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:53:45.759632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b25f8-4e1e-4ce4-8253-7a1371e3e427 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.760200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b25f8-4e1e-4ce4-8253-7a1371e3e427 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.760692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b25f8-4e1e-4ce4-8253-7a1371e3e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.781452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-229b25f8-4e1e-4ce4-8253-7a1371e3e427 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:45.783109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-229b25f8-4e1e-4ce4-8253-7a1371e3e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:45.887489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 121/245] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:45.958305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143382-14e6-4915-a9ac-89236f63222b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:45.995525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51694d-3504-4e98-8ef4-d540a5b7e412 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:45.995763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51694d-3504-4e98-8ef4-d540a5b7e412 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:45.996131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51694d-3504-4e98-8ef4-d540a5b7e412 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:45.997668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 122/246] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:46.002503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.002855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.003199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.015810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.016680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.017146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.017584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.023681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:46.024925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:46.074621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.080261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.092933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:46.094802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:46.097054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 123/247] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:46.198794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 125/248] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:46.204559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.243653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.319431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacfce-2afa-4c03-ba8a-c0013fb1bd40 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.344789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.356062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ba376-92d7-4593-8ef5-26f5fc36bb06 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.357264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.358108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.358538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.359668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.360319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:46.361940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:46.364232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:46.369852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.392711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.394766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837416-4cb8-4260-a672-11502a47164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.395562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837416-4cb8-4260-a672-11502a47164e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.395982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837416-4cb8-4260-a672-11502a47164e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.396487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837416-4cb8-4260-a672-11502a47164e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.409355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94837416-4cb8-4260-a672-11502a47164e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-94837416-4cb8-4260-a672-11502a47164e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:46.414692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:46.415733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:46.417325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:46.419619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:53:46.425479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837416-4cb8-4260-a672-11502a47164e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.511738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7036da-4dc0-430b-b8e4-1db4315ef14f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.550632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837416-4cb8-4260-a672-11502a47164e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.555974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.556589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.557381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.557652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.558471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=a69af953bcd14c09b858bb6d94ebdbe0) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:46.558781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:46.560995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:46.570087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/role_assignments?user.id=a69af953bcd14c09b858bb6d94ebdbe0&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=19fc242c01f345b588d2a42b922c6144 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:46.571156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.601461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.602102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.602410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.602682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.603380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:46.603687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:46.605204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:46.627512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:46.632186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.664304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.727947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:46.755216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120cd2e-9d1b-433e-8ea4-cb27fbc2c0a4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.797520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699d18d-6b80-41b3-846d-470ede8d6128 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:46.812439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.813080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.813748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.814039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.830036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2b6d3e63-d89b-4b41-9a8c-370769037a80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:46.837972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:46.838918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:46.840117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 126/253] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:46.840745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ed34-9bc7-487e-9157-98fb33e75947 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.841018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ed34-9bc7-487e-9157-98fb33e75947 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.841238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ed34-9bc7-487e-9157-98fb33e75947 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.844949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:46.845821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.846320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.846853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 127/254] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:46.846968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] PATH_INFO: `/v3/users/aa09b598c3754eedab56d4f43d96f884` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.848449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ed34-9bc7-487e-9157-98fb33e75947 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:46.848998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] RBAC: Authorizing `identity:get_user(user_id=aa09b598c3754eedab56d4f43d96f884)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:46.850849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c53c4-c4b4-4cbf-98d7-361fb981dfca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:46.852674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/users/aa09b598c3754eedab56d4f43d96f884 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:46.857778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:46.858259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:46.858817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:46.888596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:46.890246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:47.023016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 129/256] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:47.023868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.025277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ed34-9bc7-487e-9157-98fb33e75947 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.035853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.127607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.128310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.128682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.129050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.129816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:47.130217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:47.131940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:47.145408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 128/257] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:47.159265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.161311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147514a7-2667-4435-925b-c439f4ab6816 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.178642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.226683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.227637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.228049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.228451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.230227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:47.231854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:47.233724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 130/258] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:47.245619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.297912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12089c-bed3-4483-9b12-0ca54c5c6359 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.336976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.337618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.337893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.338718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.339867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:47.341381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:47.343275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 129/259] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:47.351459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.402674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.437170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a95d-8f6a-491e-a3f3-25801d60d8ca None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.498644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.505770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.506713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.507123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.507527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/aa09b598c3754eedab56d4f43d96f884/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.510095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, user_id=aa09b598c3754eedab56d4f43d96f884, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:47.513132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:47.534916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 131/260] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:47 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/aa09b598c3754eedab56d4f43d96f884/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:53:47.536800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.558374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b6e8e-0881-4416-83ae-a3e66028c04d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.634466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.635936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.636490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.636897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.762793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dc07-41a4-4cf0-b125-d4c6c9e13c94 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:47.775612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:47.781100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:47.855534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:47.856181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:47.856459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:47.856728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:47.879877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.893354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:47.898294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:47.899166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:53:47.899948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:47.903081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 132/261] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:47.911269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:47.926975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:47.939337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 130/262] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:47.955344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:48.087480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546acf-fdb5-4b49-a3d0-450862ef79b5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:48.153554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70328-e176-4f9a-8fda-d96b73d44ceb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:48.183905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:48.184529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:48.184811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:48.185081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:48.185753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:48.186057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:48.187474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:48.205547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:48.207406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:48.208052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:48.208329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:48.208604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:48.209734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:48.211142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:48.211272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:48.213593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 131/264] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:47 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:48.219732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:48.273385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:48.338863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:48.398704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052ebb7-0577-4820-9cb7-6754061c840a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:48.412239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451a45-885f-4ca9-ab51-0fdb2d905b7f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:48.484910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:48.487459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:48.488089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:48.489470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] PATH_INFO: `/v3/users/e7d01c18cf204c36b8a65d030e314225` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:48.491036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] RBAC: Authorizing `identity:get_user(user_id=e7d01c18cf204c36b8a65d030e314225)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:48.494028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:48.496098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 134/265] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:48 2022] GET /identity/v3/users/e7d01c18cf204c36b8a65d030e314225 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:48.504038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:48.504193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:48.504732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:48.505082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:48.505354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:48.506079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=e7d01c18cf204c36b8a65d030e314225) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:48.506426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:48.507842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:48.518996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 132/266] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:48 2022] GET /identity/v3/role_assignments?user.id=e7d01c18cf204c36b8a65d030e314225&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:48.666843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178744c-7dd9-44c6-bad1-44d8c10bd0ca None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:48.697378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:48.710478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:48.711455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:48.711923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:48.712398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:48.793631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:48.795622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:48.907126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 135/267] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:53:48.912565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:49.067492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244d2fc-867a-4763-ab7a-bdb713cb6500 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:49.069810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:49.105773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:49.106438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.106718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.106991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.108099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:49.109600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bf954-65f1-40ef-844a-6752d6f04ff8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:49.116149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 133/268] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:48 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:49.119606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:49.164823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:49.250059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264115-9e87-4c10-a65b-6ed7630556bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:49.295772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:49.296398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.296674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.296943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.297679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=e7d01c18cf204c36b8a65d030e314225) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:49.297985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:49.299494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d253a-a80b-4afb-9b76-8c37fe6a0fe1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:49.306583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 136/269] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:49 2022] GET /identity/v3/role_assignments?user.id=e7d01c18cf204c36b8a65d030e314225&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:49.399661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750b31-6273-4772-b377-fc7a78756886 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.399993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750b31-6273-4772-b377-fc7a78756886 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.400207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750b31-6273-4772-b377-fc7a78756886 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.401923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 134/270] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:49.407653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400871-81c5-4c98-9214-a596989b9f74 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.407961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400871-81c5-4c98-9214-a596989b9f74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.408200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400871-81c5-4c98-9214-a596989b9f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.435710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d7400871-81c5-4c98-9214-a596989b9f74 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:49.436932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7400871-81c5-4c98-9214-a596989b9f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:49.529411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c814-9afb-48ab-a000-6e9262c5954d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.529411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c814-9afb-48ab-a000-6e9262c5954d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.529411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c814-9afb-48ab-a000-6e9262c5954d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.530414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 135/271] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:49.535765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8e86-c67f-4d7a-a191-2464d349073c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.536043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8e86-c67f-4d7a-a191-2464d349073c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.536323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8e86-c67f-4d7a-a191-2464d349073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.540160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 137/272] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:49.557765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-296e8e86-c67f-4d7a-a191-2464d349073c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:49.559001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-296e8e86-c67f-4d7a-a191-2464d349073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:49.640528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 136/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 11 14:53:49.795848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a4a-3fec-41f0-90e6-108428a9f907 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.796345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a4a-3fec-41f0-90e6-108428a9f907 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.796752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35a4a-3fec-41f0-90e6-108428a9f907 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.798250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 138/274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:49.803801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:49.804246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:49.804655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:49.826564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:49.828079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:49.854709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35a4a-3fec-41f0-90e6-108428a9f907 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:49.892391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:49.915976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 137/275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:49.933000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:49.969483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:49.996041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35a4a-3fec-41f0-90e6-108428a9f907 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.040965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.042486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.042953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.043405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.045130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.047286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.050086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 139/276] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:50.056005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.063584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95984-0766-4477-b9ff-fa308bfdc898 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.105454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.106107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.106471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.106741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.118471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:50.123878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:50.124816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:50.125607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 138/277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:50.131047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.178593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.191087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b202ff-fd03-48b5-8ec2-62ce638657cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.233772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.234406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.234685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.234974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.236043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.237485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.239101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.249074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c322-5d21-42cc-8ee7-4d3eb06f225a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.261081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 140/278] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:53:50 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:50.261893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.319361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.321171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.321663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.322107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.323790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:50.324430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.326926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.344954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 139/279] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:50.347798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.411244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6b7f-70a5-4b38-b403-4fe4dc8f8537 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.453686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.454355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.454624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.454891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.467218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3821691f-d8b4-461a-9d57-b0d4c5da7a0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:50.473923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:50.474887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:50.475869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:50.478410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 141/280] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:50.480490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7afbc-b0f2-4ad4-a57a-96220990cd2c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.480490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7afbc-b0f2-4ad4-a57a-96220990cd2c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.480490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7afbc-b0f2-4ad4-a57a-96220990cd2c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.481761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 142/281] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:50.482507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7afbc-b0f2-4ad4-a57a-96220990cd2c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.486028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b2a48-6c59-4eaf-b1af-e8f756a72dfc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.492226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.526443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.527206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.527486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.527761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] PATH_INFO: `/v3/users/9b9ea8b78ef147249682fce598fa0d58` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.543468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] RBAC: Authorizing `identity:get_user(user_id=9b9ea8b78ef147249682fce598fa0d58)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.544935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e30e73-9449-4a07-bc87-11b88fd58eef None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.550393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/users/9b9ea8b78ef147249682fce598fa0d58 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:50.551993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.552273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.552543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.573766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:50.574910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:50.584266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.613214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7afbc-b0f2-4ad4-a57a-96220990cd2c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.650509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.651154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.651443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.651689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.652404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:50.652710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.654078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.658324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 141/283] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:50.658786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.664769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 143/284] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:50.670520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.767260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.781877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b03de-a0cf-4148-8b8a-4c9ac4178463 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.805358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc726a9-21e1-4bf9-8fc1-feec72f1456b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:50.831924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.833001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.833425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.834251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.835418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, user.id=9b9ea8b78ef147249682fce598fa0d58, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:50.835870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.838418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.842075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:50.842671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:50.843076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:50.843438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] PATH_INFO: `/v3/users/a69af953bcd14c09b858bb6d94ebdbe0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:50.844716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] RBAC: Authorizing `identity:get_user(user_id=a69af953bcd14c09b858bb6d94ebdbe0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:50.845547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 142/285] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/role_assignments?user.id=9b9ea8b78ef147249682fce598fa0d58&scope.system=all&role.id=44a03d54df6f4580a9f4933398e65018 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:50.849021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:50.849021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/users/a69af953bcd14c09b858bb6d94ebdbe0 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:50.854203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.867192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:50.947845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:50.996398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6df61-8baf-454e-98a2-0561a730804a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.035100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.035747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.036026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.036299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.037488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:51.038965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:51.041003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:51.046562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:51.145750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fffc8e-a8a3-40be-a227-769909f11372 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.169989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:51.194915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.195559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.195836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.196109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.199363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:51.210456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:51.216384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:51.217276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:51.218039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:51.218653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 145/288] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:51.227317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:51.243228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068091ef-28fa-4131-8c01-9f5f20001b25 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.311131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.311804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.312082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.312353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/a69af953bcd14c09b858bb6d94ebdbe0/roles/19fc242c01f345b588d2a42b922c6144` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.316449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, user_id=a69af953bcd14c09b858bb6d94ebdbe0, role_id=19fc242c01f345b588d2a42b922c6144)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:51.317899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:51.339352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 144/289] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:53:51 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/users/a69af953bcd14c09b858bb6d94ebdbe0/roles/19fc242c01f345b588d2a42b922c6144 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:53:51.396916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74b3c9-7ac7-4ac6-83ea-8dc5bb78f67b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.438005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.438704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.438985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.439258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.439927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:51.440227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:51.441630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:51.451467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:51.457281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:51.579057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40782-4fa7-48fe-8896-810ba783f43e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.614708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.615345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.615621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.615887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] PATH_INFO: `/v3/users/aa09b598c3754eedab56d4f43d96f884` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.617046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] RBAC: Authorizing `identity:get_user(user_id=aa09b598c3754eedab56d4f43d96f884)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:51.618496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:51.620433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:51 2022] GET /identity/v3/users/aa09b598c3754eedab56d4f43d96f884 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:51.626061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:51.700576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:51.755327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede435-d4e9-492a-ae37-bded88f87297 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:51.802315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:51.802941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:51.803223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:51.803544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:51.881331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:51.882840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:51.943724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:52.001364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:52.006800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:52.009711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:52.144370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed45f-76c4-453c-a826-a041da6fbae3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:52.187594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:52.188330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:52.188613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:52.188936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:52.190159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:52.191632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18361a-53e4-4a1e-a49e-fa9c90584315 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:52.193614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:52 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:52.200005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:52.307426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3fa49-06f0-4b70-bdcf-0e55f16a4052 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:52.356695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:52.357312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:52.357729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:52.358005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:52.358836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=aa09b598c3754eedab56d4f43d96f884) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:52.359147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:52.360612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa43d9-1829-4124-9a67-59e83c1494c0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:52.373762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:52 2022] GET /identity/v3/role_assignments?user.id=aa09b598c3754eedab56d4f43d96f884&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=44a03d54df6f4580a9f4933398e65018 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:52.990310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cd47-2858-4178-91fb-fc9988a63a17 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:52.990310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cd47-2858-4178-91fb-fc9988a63a17 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:52.990310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cd47-2858-4178-91fb-fc9988a63a17 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:52.991261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 147/295] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:52.997211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:52.997717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:52.998207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.000476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80995-58ba-4664-b022-196110b2869a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.000966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80995-58ba-4664-b022-196110b2869a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.001453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80995-58ba-4664-b022-196110b2869a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.003233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 148/296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:53:53.008474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.009414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.010468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.017580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:53.018951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:53.030747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:53.032211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:53.036605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:53.092372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 149/297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:53.115302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:53.126385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 149/298] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:53.362337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.409226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.471381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a719c-be02-4ecc-af38-4f402f45e5b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:53.512155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:53.513142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.513635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.514112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.524933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eeecd-449f-440e-886a-f9e5ac9a06d6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:53.525972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:53.531338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:53.532214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:53.532979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:53.535276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 150/299] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:53.541441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.558482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:53.567287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:53.567920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.568381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.568795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.570037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:53.572165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:53.574751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 150/300] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:53.580554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.652564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:53.654004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f451a-9af2-4c59-8882-36e1d5f23e4a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:53.690117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:53.690747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.691025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.691123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b1d3-8337-4c09-a7ec-505feeb09ccf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:53.691293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.691949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:53.692248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:53.693637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1790-029e-45a3-9f0b-8fb09a8d2cdb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:53.706933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 151/301] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:53.706933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e6ffb-4a01-4db2-a54b-01a166e535e9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.706933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e6ffb-4a01-4db2-a54b-01a166e535e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.706933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e6ffb-4a01-4db2-a54b-01a166e535e9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.706933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 152/302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:53.710923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e6ffb-4a01-4db2-a54b-01a166e535e9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.731303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:53.731920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.732260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.732536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] PATH_INFO: `/v3/groups` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.733594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:53.735064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fb77-4b04-4aa5-ba63-d3d0b0e78a19 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:53.760588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 151/303] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 14:53:53 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:53:53.760588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.760588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.760588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.775736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:53.777458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:53.803479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:53.839852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e6ffb-4a01-4db2-a54b-01a166e535e9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:53.864055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 152/304] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:53.884001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:53.885554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:53.886024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:53.886508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] PATH_INFO: `/v3/users/37b0ec0990a241b5af6f90e078a5f5c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:53.902500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] RBAC: Authorizing `identity:get_user(user_id=37b0ec0990a241b5af6f90e078a5f5c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:53.904402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:53.906779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 153/305] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:53 2022] GET /identity/v3/users/37b0ec0990a241b5af6f90e078a5f5c3 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:53.912376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:53.976404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:54.020927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d69ab-fb77-4010-80a6-9756b50a2441 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.055894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.056500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.057316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.057592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.058330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, user.id=37b0ec0990a241b5af6f90e078a5f5c3, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:54.058656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:54.060077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2cc4-2533-4b2e-98e8-a7453115f9b9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:54.065407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 153/306] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 14:53:53 2022] GET /identity/v3/role_assignments?user.id=37b0ec0990a241b5af6f90e078a5f5c3&scope.system=all&role.id=19fc242c01f345b588d2a42b922c6144 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:54.147238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.233408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3314-5ea2-4fbf-92c2-73de3b063eee None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.233711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3314-5ea2-4fbf-92c2-73de3b063eee None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.233884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3314-5ea2-4fbf-92c2-73de3b063eee None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.235619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 154/307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:54.241335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.241620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.241898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.262140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fe22e-d4bd-4c2a-b231-e706968d1f60 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.262695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:54.264080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:54.294581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:54.304685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.305319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.305591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.305858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.319209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:54.324256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:54.325117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:54.325916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 154/308] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:54.331234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.343524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 155/309] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:54.436671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2806b1-91f5-4858-b928-d7eb2907bf9f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.471303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.471915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.472187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.472455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.473173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:54.473482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:54.474881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:54.483984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 155/310] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:54.489435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.551276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:54.602164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e142c-ea54-4f76-87c6-8768e2ce63a7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.637831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.638711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.638842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.639099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] PATH_INFO: `/v3/users/9b9ea8b78ef147249682fce598fa0d58` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.639693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.640243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9ea8b78ef147249682fce598fa0d58)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:54.641688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:54.643439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 156/311] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:54 2022] GET /identity/v3/users/9b9ea8b78ef147249682fce598fa0d58 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:54.651558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.702751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:54.767484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053aff5-ab01-4e76-9f47-cbff6b4348c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.782054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c853d-99a7-4183-b5a8-a6ddba5db047 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.807414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:54.816814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.817712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.817990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.818474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.827994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:54.828736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:54.829084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:54.829564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] PATH_INFO: `/v3/system/users/9b9ea8b78ef147249682fce598fa0d58/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:54.830254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:54.831257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b9ea8b78ef147249682fce598fa0d58, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:54.832646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:54.835820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:54.836654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:54.837428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:53:54.838570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 156/312] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:53:54.844013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:54.847035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 157/313] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 14:53:54 2022] PUT /identity/v3/system/users/9b9ea8b78ef147249682fce598fa0d58/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:53:54.960751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12b4ba-ef7f-4185-aed1-3eb0dc9727fd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:54.981476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:55.003995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:55.004866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:55.005309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:55.005716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:55.006629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:55.007072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:55.008663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:55.022468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:55.024804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:55.131590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd26d-916a-4c4a-9567-20ada3cf0b51 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:55.168234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:55.169220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:55.169675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:55.170116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] PATH_INFO: `/v3/users/a69af953bcd14c09b858bb6d94ebdbe0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:55.171434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=a69af953bcd14c09b858bb6d94ebdbe0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:55.173026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:55.178740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 158/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:55 2022] GET /identity/v3/users/a69af953bcd14c09b858bb6d94ebdbe0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:55.181304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:55.292110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269745b-74c8-4a89-a149-529c0cd1074a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:55.327028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:55.327647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:55.327923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:55.328194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:55.375228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:55.401161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:55.402655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:55.505119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 158/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:53:55.512068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:55.566980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:55.617685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6838-74b9-4a71-97b9-11e596cb0bc6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:55.653182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:55.654146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:55.654672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:55.655137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:55.656446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:55.658055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8d3c0-df7f-4423-884e-0659f1dab89c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:55.664702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:53:55 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:55.666441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:55.748578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:55.773028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e38d-d679-42b9-984f-234a53d10188 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:55.810753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:55.811386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:55.811665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:55.811938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:55.812682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3, user.id=a69af953bcd14c09b858bb6d94ebdbe0) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:55.812990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:55.814506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf95ed5-bffa-4807-b129-b1c8c51b6d91 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:55.821419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 159/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:53:55 2022] GET /identity/v3/role_assignments?user.id=a69af953bcd14c09b858bb6d94ebdbe0&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=19fc242c01f345b588d2a42b922c6144 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:56.228812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8b2c-c1c2-42f9-a3ac-b37d1bdcdc4b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.229366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8b2c-c1c2-42f9-a3ac-b37d1bdcdc4b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.229366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8b2c-c1c2-42f9-a3ac-b37d1bdcdc4b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.230991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:56.236241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450573-8709-4939-af8b-78a5f631d752 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.236526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450573-8709-4939-af8b-78a5f631d752 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.236793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450573-8709-4939-af8b-78a5f631d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.255267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-57450573-8709-4939-af8b-78a5f631d752 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:56.256443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-57450573-8709-4939-af8b-78a5f631d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:56.308737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16913-4b98-47ba-bdee-db4e76d3d297 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.309037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16913-4b98-47ba-bdee-db4e76d3d297 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.309289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16913-4b98-47ba-bdee-db4e76d3d297 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.310812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 161/320] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:56.315427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.315716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.315996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.324631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 160/321] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:56.334403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:56.335603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:56.404047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 162/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:53:56.586715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57450573-8709-4939-af8b-78a5f631d752 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:56.653858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:56.680428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:56.687472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57450573-8709-4939-af8b-78a5f631d752 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:56.724930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:56.725582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.726145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.726468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.727678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:56.729795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:56.732126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 161/323] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:53:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:56.733919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:56.738290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:56.783925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2999222-8740-495f-bb46-d3e5d7a5567e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:56.819856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:56.820740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.821173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.821585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.833258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:56.838349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:56.839397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:53:56.840377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:56.842291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 163/324] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:56.846734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d3cc-9b9e-42ad-8008-8ebb066376a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:56.847941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:56.883259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:56.884224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:56.885206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:56.885672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] PATH_INFO: `/v3/groups` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:56.886510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:56.888225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:56.900855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:56.914523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 162/325] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 14:53:56 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:53:56.968088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f84aa-f054-4b62-b7d2-aba7508fc754 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:56.984366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:57.013720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:57.014375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.014655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.014922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.015597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:57.015899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:57.017320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fcc3d-2d90-468b-b3af-9da58a526366 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:57.031851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 164/326] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:53:57.032905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:57.109655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfb7f-acde-4242-86df-22d8ac0d74b2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.109867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfb7f-acde-4242-86df-22d8ac0d74b2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.110134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfb7f-acde-4242-86df-22d8ac0d74b2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.111831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 165/327] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:57.117260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.117618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.117902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.141876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:57.143116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:57.144782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b8ec-d2f7-4957-9285-99d1e57d00ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:57.189685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:57.190520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.190803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.191060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] PATH_INFO: `/v3/users/37b0ec0990a241b5af6f90e078a5f5c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.192246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] RBAC: Authorizing `identity:get_user(user_id=37b0ec0990a241b5af6f90e078a5f5c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:57.193692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:57.196231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:57 2022] GET /identity/v3/users/37b0ec0990a241b5af6f90e078a5f5c3 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:57.201651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:57.226434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 166/329] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:53:57.274235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:57.310665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7598-cdf9-4658-b8d4-b444902d99ae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:57.345726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:57.346423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.346698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.346967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] PATH_INFO: `/v3/system/users/37b0ec0990a241b5af6f90e078a5f5c3/roles/19fc242c01f345b588d2a42b922c6144` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.348407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37b0ec0990a241b5af6f90e078a5f5c3, role_id=19fc242c01f345b588d2a42b922c6144)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:57.349780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:57.361915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 14:53:57 2022] PUT /identity/v3/system/users/37b0ec0990a241b5af6f90e078a5f5c3/roles/19fc242c01f345b588d2a42b922c6144 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:53:57.501972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:57.610711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e8da-137d-43a7-bd03-73a7bc76fbc6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:57.612341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:57.647705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:57.648341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.648621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.648893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.659759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:53:57.664562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:53:57.665398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:53:57.667098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 167/331] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:53:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:53:57.672287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:57.783552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae327-a017-4288-8b5d-6d3d560fd0ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:57.824229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:57.831850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:57.832935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:57.833592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:57.834571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:57.835602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:57.836308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:57.839112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:57.850590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 165/332] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:53:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:57.857714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:57.989765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d267-fd15-4984-b4f4-f879e8600ca8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:58.030395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:58.031044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:58.031319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:58.031588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] PATH_INFO: `/v3/users/9b9ea8b78ef147249682fce598fa0d58` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:58.032733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9ea8b78ef147249682fce598fa0d58)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:58.034180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c504-05ac-433d-a74a-86a3e1fed207 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:58.036099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 168/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:53:57 2022] GET /identity/v3/users/9b9ea8b78ef147249682fce598fa0d58 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:58.042139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:53:58.166445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d47e-7d96-4656-a4d3-41a0c2730791 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:53:58.210148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:53:58.210783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:58.211060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:58.211329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:58.212069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] RBAC: Adding query filter params (role.id=44a03d54df6f4580a9f4933398e65018, user.id=9b9ea8b78ef147249682fce598fa0d58, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:53:58.212359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:53:58.213854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b49a-3613-4786-9c0f-150ca6d25678 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:53:58.230016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 166/334] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 14:53:58 2022] GET /identity/v3/role_assignments?user.id=9b9ea8b78ef147249682fce598fa0d58&scope.system=all&role.id=44a03d54df6f4580a9f4933398e65018 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:53:59.471935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a1a3-2f8e-4281-8c16-6553c9a77a16 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:59.472447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a1a3-2f8e-4281-8c16-6553c9a77a16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:59.472447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8a1a3-2f8e-4281-8c16-6553c9a77a16 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:59.474138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 169/335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:53:59.480471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5867e3-1282-4176-9abb-2c2c7c9aae48 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:53:59.481322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5867e3-1282-4176-9abb-2c2c7c9aae48 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:53:59.481782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5867e3-1282-4176-9abb-2c2c7c9aae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:53:59.501144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ff5867e3-1282-4176-9abb-2c2c7c9aae48 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:53:59.502660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ff5867e3-1282-4176-9abb-2c2c7c9aae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:53:59.563398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:53:59.585203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 167/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:00.121411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8a1a3-2f8e-4281-8c16-6553c9a77a16 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:00.157916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:00.260130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8a1a3-2f8e-4281-8c16-6553c9a77a16 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:00.290480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b839-891c-4a94-ab56-56cf7d8e50b9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.290777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b839-891c-4a94-ab56-56cf7d8e50b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.291188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b839-891c-4a94-ab56-56cf7d8e50b9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.296950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 168/337] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:00.298465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026b8-e68d-472c-9641-2d73e619d436 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.298942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026b8-e68d-472c-9641-2d73e619d436 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.299404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026b8-e68d-472c-9641-2d73e619d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.313533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:00.314175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.314481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.314755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.335801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f20026b8-e68d-472c-9641-2d73e619d436 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:00.337315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f20026b8-e68d-472c-9641-2d73e619d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:00.346318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:00.348088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:00.348928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:00.350093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 170/338] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:00.366145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:00.489469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:00.491074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 169/339] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:00.498550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2198-de5e-4a02-9229-ab0363af0938 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.499213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2198-de5e-4a02-9229-ab0363af0938 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.499682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2198-de5e-4a02-9229-ab0363af0938 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.501291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 170/340] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:00.502869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c499ca9-fafb-413e-9f32-c0bb8f6d809b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.503406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c499ca9-fafb-413e-9f32-c0bb8f6d809b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.503848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c499ca9-fafb-413e-9f32-c0bb8f6d809b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.505213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 171/341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:00.507654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.508163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.508619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.512888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac233-6b18-4cdd-b195-353f9e93e8ca None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:00.539589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:00.540778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:00.574994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:00.575611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.575884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.576149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.576805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:00.577106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:00.578499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b190e-16da-499a-bd65-c4ea21bae67f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:00.587163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 171/342] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:00.588603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.589019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.589425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.620642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:00.622426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:00.630094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:00.631200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:00.702647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:00.740765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 172/344] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:00.793876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c5c2-655a-4880-be9b-9a7782b1862c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:00.836520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:00.837378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:00.838370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:00.838786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:00.934300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:00.935780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:00.958559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.020929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.095023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.125560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5b52b-6b13-46a4-bcff-797d99965815 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.151844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 173/345] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:01.155290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.164640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.165612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.166669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.167079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.177921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:01.183581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:01.184653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:01.185594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:01.188158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 173/346] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:01.189218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.302414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f797-90a7-4379-ad62-0899bea94b7f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.314234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb149d-6231-41e8-ad73-6c62f9bebbf5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.350841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.351547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.352299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.352684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.361332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.362388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.362834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.363259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.364009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.366183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:01.367493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:01.368247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:01.370106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 174/347] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:01.371024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:01.376732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:01.377711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:01.378543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:01.381129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 174/348] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:01.382749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.386255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.492239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e163-0f88-461d-8b7a-0fdc2f76370f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.521790 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd157f-49a4-472f-bb26-f8930936bd2c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.541368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.543018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.543551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.544345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.545203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:01.545695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:01.547815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:01.558872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 175/349] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:01.560364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.562951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.563974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.564254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.564522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.575887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:01.582561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:01.583421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 175/350] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:01.584840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.665085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.678215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.708298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2dce-d5b9-4c74-886a-f0d86a286626 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.726578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e807eb-0a96-47e3-be63-ddd70df2ac6f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.753589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.754840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.755219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.755720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.765690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:01.767566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:01.768403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.769018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.769297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.769570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.770240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:01.770540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 176/351] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:01.770671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:01.771605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.771936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:01.784513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 176/352] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:01.785544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:01.904874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7a61-b2d0-4236-ae21-46a55e600fe3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.914507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c8b8a-67f2-4ca7-8a5f-99059ba8ca39 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:01.942300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.950103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.951112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.951392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.951974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.957015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:01.958874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:01.960187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.960868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.961514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.962286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:01.962596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:01.964044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038ae01-e7ea-4075-8f22-132e273cd1fa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:01.975039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 177/353] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:01.976362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1723bd-a2f5-488e-82d0-fb09d769d526 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:01.976651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1723bd-a2f5-488e-82d0-fb09d769d526 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:01.976922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1723bd-a2f5-488e-82d0-fb09d769d526 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:01.978868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 178/354] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:01.979454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1723bd-a2f5-488e-82d0-fb09d769d526 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.054036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.055613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298edfc-a6ba-47e3-afc1-1677270797be None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.113320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1723bd-a2f5-488e-82d0-fb09d769d526 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.160278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.160891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.161164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.161431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.162526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=82cd53828e69487a8918277ec483c67a) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:02.162835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.165212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.171596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 179/355] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=44a03d54df6f4580a9f4933398e65018 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:02.172407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.191989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 177/356] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:02.194845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.195412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.195905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.216678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:02.218433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:02.233536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.267562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.304196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ffc1-fc19-475c-8eac-eb499c635ab0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.324237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 178/357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:02.325106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.357235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.358901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.359684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.360161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.456539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.457443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb25de-1390-4c45-8000-59e2dbf040f4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.457906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eae9a-caca-4699-92af-9bc3246b5c3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.519979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.521466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.522056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.522366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.522638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] PATH_INFO: `/v3/users/37b0ec0990a241b5af6f90e078a5f5c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.524886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] RBAC: Authorizing `identity:get_user(user_id=37b0ec0990a241b5af6f90e078a5f5c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.527663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.530456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 179/358] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/users/37b0ec0990a241b5af6f90e078a5f5c3 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:02.531799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.575268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 180/359] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:02.576577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7981-8759-40ce-bc70-268a07fa9e19 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.576859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7981-8759-40ce-bc70-268a07fa9e19 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.576960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.577118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7981-8759-40ce-bc70-268a07fa9e19 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.582300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 181/360] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:02.583153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b7981-8759-40ce-bc70-268a07fa9e19 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.667427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047763d-8b89-45cd-950a-5121642d2c02 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.708113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b7981-8759-40ce-bc70-268a07fa9e19 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.709255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.710201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.710764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.711248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.712630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.714321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.716266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 180/361] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:02.717288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.756254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.756902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.757241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.757511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.758237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] RBAC: Adding query filter params (role.id=19fc242c01f345b588d2a42b922c6144, user.id=37b0ec0990a241b5af6f90e078a5f5c3, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:02.758602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.760564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22371e1-2592-4531-8a0c-eca79309acfb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.779339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 182/362] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/role_assignments?user.id=37b0ec0990a241b5af6f90e078a5f5c3&scope.system=all&role.id=19fc242c01f345b588d2a42b922c6144 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:02.780688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.780967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.781235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.795239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.802129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:02.804089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:02.846228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25cd71-78c8-47cb-aebe-e347a1dba34e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:02.849138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:02.896691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:02.897343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:02.897622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:02.897894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:02.899362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:02.901666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:02.904118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 181/363] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:02.908734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:02.914232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 183/364] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:02.914466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.059484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaae7-4bf7-466b-9ce4-7b61975a5d21 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.085730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174f7b-95eb-4b6d-a026-db6d475a2e8e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.105630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.106282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.106563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.106831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.108682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.110111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.111896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 182/365] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.113149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.141847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.143001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.143485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.143986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.148764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.158903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:03.165178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:03.166180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:03.167039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:03.169456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 184/366] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:03.170567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.177054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.240300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d71-0948-45a1-8ea3-9f97839ff6ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.279003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.279666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.279946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.280215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.281750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.283203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.285060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 183/367] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.285828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.288126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903acfb-ac1b-4a80-bbe2-babab65df700 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.336893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.337180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.337316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.337662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.339587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=82cd53828e69487a8918277ec483c67a) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:03.339587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.344276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.349013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 185/368] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.349666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.451583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.454785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458fd4d-795d-4113-8b4a-c685b840b3b6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.468845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.511606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6541b-7162-43f3-8c00-341c1b087e52 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.512598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.513296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.513650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.513997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.515122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:03.515503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.518057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.529925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.530650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.556640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.557609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.559103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.559579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.571662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:03.578016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:03.579365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:03.580169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:03.582808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:03.583791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.650986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5388-fada-4901-a7f9-8955c906261d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.688569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.689659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.690124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.690596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.691550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:03.692098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.693756 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.701060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=44a03d54df6f4580a9f4933398e65018 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.701870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:03.702962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce960-c5c7-454c-a7ba-1ca833292b17 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.728534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.736493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:03.760485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.761468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.762002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.762497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.818880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9ecb-f2c4-4eee-96a2-cf3816578837 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:03.866549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:03.867587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:03.868202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:03.868810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:03.872502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:03.872814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.874242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.883722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:03.885656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:03.904622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 186/372] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:03.909971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.045987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 187/373] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:04.052046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.087669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:04.091213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:04.101594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2713b1-c29d-4fab-a39f-85df76224995 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.167439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:04.168058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.168336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.168609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.221164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41208b65-6075-4469-a3d6-7c8f36f92901 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.280357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:04.280992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.281268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.281533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.282795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:04.284239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:04.286082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 188/374] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:04 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:04.297729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.298769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:04.300238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:04.446642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:04.457755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 187/375] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:54:04.465424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.493536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:04.518770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bdae-a06f-4f12-a1fa-c653f7412b66 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.585866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:04.586497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.586728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.586991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.589608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:04.591172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:04.593130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 189/376] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:04 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:04.609569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.647749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73a8-b3e4-4cf4-a23a-9d0a5d53a7bb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.711550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:04.714515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.714797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.715071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] PATH_INFO: `/v3/projects/7334057aea374090aa685d1856ec911f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.717428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] RBAC: Authorizing `identity:get_project(project_id=7334057aea374090aa685d1856ec911f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:04.718913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:04.721338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:04 2022] GET /identity/v3/projects/7334057aea374090aa685d1856ec911f => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:04.727497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:04.823642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1addf-15fd-43bb-8c03-f075b6a90c50 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.863737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:04.906152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:04.906841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.907119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.907388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.908123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:04.908426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:04.909871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24821011-6b35-4039-b34b-0afea07d3c0a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:04.925144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 190/378] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:04 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 260 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:04.931663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82d39-f10a-420c-9d06-74ee073136a9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.931936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82d39-f10a-420c-9d06-74ee073136a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.932209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82d39-f10a-420c-9d06-74ee073136a9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.933565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 191/379] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:04.941943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:04.942262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:04.942527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:04.948033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da706-d8f3-43ef-9e53-167e485e5cad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:04.986859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:04.988202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:05.018818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:05.030674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:05.031386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:05.031666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:05.031937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] PATH_INFO: `/v3/groups/756b886b88524e13a95ad9c350bdc538` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:05.042036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] RBAC: Authorizing `identity:get_group(group_id=756b886b88524e13a95ad9c350bdc538)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:05.043549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:05.047370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 189/380] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:04 2022] GET /identity/v3/groups/756b886b88524e13a95ad9c350bdc538 => generated 229 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:05.052025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:05.128641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 192/381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:05.209453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827e6b-9ae6-4190-beeb-bd0a51b8e2aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:05.240177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:05.256080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:05.256701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:05.256981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:05.257251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:05.257979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] RBAC: Adding query filter params (group.id=756b886b88524e13a95ad9c350bdc538, role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=7334057aea374090aa685d1856ec911f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:05.258302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:05.259790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:05.266316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 190/382] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:05 2022] GET /identity/v3/role_assignments?group.id=756b886b88524e13a95ad9c350bdc538&scope.project.id=7334057aea374090aa685d1856ec911f&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:05.578391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:05.701222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703701b-a147-45ef-8b2e-077f4c897dd4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:05.741826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:05.742488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:05.742764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:05.743029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:05.760009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:05.764815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:05.765693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:05.766518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:05.770371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 193/383] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:05.772093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:05.876888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af602-b95a-4a0c-85f5-07a9686382aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:05.911140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:05.911751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:05.912025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:05.912295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:05.912962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:05.913259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:05.914646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:05.928577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 191/384] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:05.929906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:05.943001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:06.076340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a225885-b282-48ee-8c16-160a25546fce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:06.117013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:06.117656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.117929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.118189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.119897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:06.121355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ab25d-2ec1-4e5a-a611-446d2f7e0a69 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:06.127296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 194/385] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:05 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:06.132992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:06.154516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65459c-3256-4150-9903-cee99673b076 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.154822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65459c-3256-4150-9903-cee99673b076 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.155063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65459c-3256-4150-9903-cee99673b076 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.156850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 195/386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:06.162716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.162996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.163267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.186634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:06.187838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:06.219469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:06.300047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 196/387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:06.307461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294856d-323f-49a6-b7a4-410e281601ab None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:06.341864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:06.342786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.343202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.343611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.344863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:06.346466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6cc40-a252-4e45-b06b-67b18b94ba51 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:06.348221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 192/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:06 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:06.354317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:06.366373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:06.473266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939c43-22b6-49bc-a809-ce6a1651c1ea None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:06.511705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:06.512372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.512646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.512913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/groups/478c1a0ace894201a90ce4be3f4e3995/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.515022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, group_id=478c1a0ace894201a90ce4be3f4e3995, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:06.516468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdcfa6-b5bf-4811-8d80-651fbe16d77c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:06.535145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 197/389] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 14:54:06 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/groups/478c1a0ace894201a90ce4be3f4e3995/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:06.585811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001996ac-6af5-4978-b37b-f376d7d66d03 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.586146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001996ac-6af5-4978-b37b-f376d7d66d03 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.586405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001996ac-6af5-4978-b37b-f376d7d66d03 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.588432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 193/390] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:06.594715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.595083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.595355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.619789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:06.621072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:06.655927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001996ac-6af5-4978-b37b-f376d7d66d03 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:06.699451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:06.708413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 198/391] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:06.833245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001996ac-6af5-4978-b37b-f376d7d66d03 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:06.858333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:06.876088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:06.876713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:06.876984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:06.877252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:06.888219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:06.892995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:06.893872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:06.894700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 194/392] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:06.901293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.005389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.044674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dddec-7af3-4de4-a703-f23c0032c8c5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.096260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.096806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.097080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.097344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.098013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:07.098326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.099924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.120062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 199/393] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:07.127193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.129299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494edb-7ac7-4fd7-aa41-1705fec70d03 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.164875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.165511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.166349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.166623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.177623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:07.184021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:07.184932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:07.185713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 195/394] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:07.192766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.213425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:07.248452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:07.267821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca57d-b627-4a3e-ac31-959727d5ed53 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.305202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.306074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.306576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.307013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.308269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.310053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.312967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 200/395] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:07.319689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.354607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6713c-b9b1-4242-a055-0f5118531186 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.415259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.416395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.416664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.416926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.417583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:07.417876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.419287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.428800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 196/396] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:07.434312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.512411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9d8a-1e29-45b9-9ecb-f2b925870c39 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.554657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:07.583500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.584146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.584426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.584697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.590313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2faf-c16d-43e1-b025-e0ac2d5fae06 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.590958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.592282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:07.592798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.594933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 201/397] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:07.605135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.638772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.639410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.639741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.640019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.641178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.642655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.644693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 197/398] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:07.655330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.801472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ae6dd-daa1-4748-b7ff-ee4d29f1ec53 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.824459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5fb3d-6779-4c38-b842-eaa5f322c15b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:07.869562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.870148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.870456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.870724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a/groups/478c1a0ace894201a90ce4be3f4e3995/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.874114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cd53828e69487a8918277ec483c67a, group_id=478c1a0ace894201a90ce4be3f4e3995, role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.875570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18782a92-8b02-443c-a9a4-41c89a2d68b6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.882958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:07.883664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.884062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.884389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.885607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:07.888192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:07.891244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 198/399] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:07 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:07.896821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:07.900451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 14:54:07 2022] PUT /identity/v3/projects/82cd53828e69487a8918277ec483c67a/groups/478c1a0ace894201a90ce4be3f4e3995/roles/dc8bbaa1778e437ab64402e812b88365 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:07.928887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e07c4-df7c-43c0-a361-1aeb50c6a988 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.929232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e07c4-df7c-43c0-a361-1aeb50c6a988 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.929422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e07c4-df7c-43c0-a361-1aeb50c6a988 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.930849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 203/401] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:07.937018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c0a3-07ff-41fa-b97e-843bcccb4058 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:07.937305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c0a3-07ff-41fa-b97e-843bcccb4058 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:07.937551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c0a3-07ff-41fa-b97e-843bcccb4058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:07.956028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:07.974532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ea89c0a3-07ff-41fa-b97e-843bcccb4058 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:07.976219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea89c0a3-07ff-41fa-b97e-843bcccb4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:08.034109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbaf23-4065-4fb9-88b1-da4122bacaa4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:08.073369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:08.074049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:08.074349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:08.074623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/groups/478c1a0ace894201a90ce4be3f4e3995/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:08.076739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, group_id=478c1a0ace894201a90ce4be3f4e3995, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:08.078181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:08.094621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:08.095866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 199/402] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 14:54:07 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/groups/478c1a0ace894201a90ce4be3f4e3995/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:54:08.120742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 204/403] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:08.418748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:08.555016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:08.561753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946784b-a648-4c91-8870-5c828a1b8f41 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:08.564562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b26a-0626-4ee9-92f2-4dc6a6bde05d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:08.564846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b26a-0626-4ee9-92f2-4dc6a6bde05d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:08.565162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b26a-0626-4ee9-92f2-4dc6a6bde05d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:08.566850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 205/404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:08.575559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345a99-f03f-45f7-ae59-91176700484b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:08.575841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345a99-f03f-45f7-ae59-91176700484b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:08.576115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345a99-f03f-45f7-ae59-91176700484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:08.598791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:08.599710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:08.600163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:08.600633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:08.615477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-49345a99-f03f-45f7-ae59-91176700484b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:08.617210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-49345a99-f03f-45f7-ae59-91176700484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:08.617894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:08.626298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:08.627236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:08.628021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 200/405] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:08.633324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:08.701880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 206/406] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:08.783562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888fd8-8fab-42b3-95b2-24baeb7d1ef7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:08.820380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:08.821255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:08.821710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:08.822238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:08.823092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:08.823591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:08.825304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:08.834004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 201/407] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:08.840094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345a99-f03f-45f7-ae59-91176700484b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:08.986036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345a99-f03f-45f7-ae59-91176700484b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.010489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.014601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:09.037468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:09.052669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.053096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.053372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.053644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.054801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:09.056308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:09.058902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 207/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:08 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:09.063847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.130945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e490c-ab76-48be-a9b1-ec99b157f5e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.175055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.176082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.176566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.177311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.189893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:09.197343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:09.198194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:09.199020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:09.201545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 202/409] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:09.207107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.286305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec62-deba-460b-b589-b2c89bf003e9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.361816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.365304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.374256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.375022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.377203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:09.380236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:09.387585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 208/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:09 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:09.389862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.406681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:09.467647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383700ee-d0ec-4637-8094-417e41f081b8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.561627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:09.571569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.572933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.573419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.574437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.575947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:09.576482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:09.579310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf4ee0-dc60-4488-bd30-dddc9a06ae39 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:09.598196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 203/411] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:09.600598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934c602-2177-4fbf-9bf9-9fbda503ad04 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.601074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934c602-2177-4fbf-9bf9-9fbda503ad04 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.602059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934c602-2177-4fbf-9bf9-9fbda503ad04 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.605739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 204/412] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:09.607021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934c602-2177-4fbf-9bf9-9fbda503ad04 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.624022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef39ab-043b-4961-9f07-62683d3d4d12 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.664924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.666405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.666686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.666957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/groups/478c1a0ace894201a90ce4be3f4e3995/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.669241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7b06c46a8f40569b4e30f9fe7592c3, group_id=478c1a0ace894201a90ce4be3f4e3995, role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:09.670848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5569c-030c-4a00-94ae-2b7bf9221bd0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:09.698470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 209/413] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 14:54:09 2022] PUT /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3/groups/478c1a0ace894201a90ce4be3f4e3995/roles/dc8bbaa1778e437ab64402e812b88365 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:09.700070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.700495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.700940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.738990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:09.740222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:09.782213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934c602-2177-4fbf-9bf9-9fbda503ad04 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:09.855028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 210/414] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:09.863187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:09.863838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:09.864120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:09.864393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] PATH_INFO: `/v3/groups/756b886b88524e13a95ad9c350bdc538` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:09.871174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] RBAC: Authorizing `identity:get_group(group_id=756b886b88524e13a95ad9c350bdc538)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:09.872653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:09.874435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 205/415] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:09 2022] GET /identity/v3/groups/756b886b88524e13a95ad9c350bdc538 => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:09.880282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:09.945329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:10.025902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4d96-498d-4df6-b82e-cdd808054b02 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:10.063595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:10.064228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.064498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.064763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] PATH_INFO: `/v3/projects/7334057aea374090aa685d1856ec911f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.065869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] RBAC: Authorizing `identity:get_project(project_id=7334057aea374090aa685d1856ec911f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:10.067334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:10.069234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 211/416] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:09 2022] GET /identity/v3/projects/7334057aea374090aa685d1856ec911f => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:10.075489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:10.104116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:10.167355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:10.200973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1cb3a-689f-4396-83e9-20003bbc51aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:10.245202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:10.245872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.246152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.246459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] PATH_INFO: `/v3/projects/7334057aea374090aa685d1856ec911f/groups/756b886b88524e13a95ad9c350bdc538/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.248339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] RBAC: Authorizing `identity:create_grant(project_id=7334057aea374090aa685d1856ec911f, group_id=756b886b88524e13a95ad9c350bdc538, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:10.249777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:10.269822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 206/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 14:54:10 2022] PUT /identity/v3/projects/7334057aea374090aa685d1856ec911f/groups/756b886b88524e13a95ad9c350bdc538/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:54:10.345514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed06cbe-cba6-4fd0-ad99-b2739d976e4f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:10.361034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:10.387358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:10.388089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.388378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.388647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.408948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:10.414022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:10.415030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:10.415995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 212/418] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:10.421768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:10.519097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:10.560687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ad52-c6eb-47c2-8e13-bb3b55843e48 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:10.611009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:10.612007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.612482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.612957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.613822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:10.614361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:10.615913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fae9c-3973-42d7-93a0-61caa9f20f92 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:10.625019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 207/419] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:10.630378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:10.691833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53878-46f1-43f4-8738-eda06e01b813 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.692438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53878-46f1-43f4-8738-eda06e01b813 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.692929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53878-46f1-43f4-8738-eda06e01b813 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.694559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 208/420] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:10.709399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcdec9-54b5-4cc7-955b-0d0ec44a961a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.709971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcdec9-54b5-4cc7-955b-0d0ec44a961a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.710468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcdec9-54b5-4cc7-955b-0d0ec44a961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.749211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-40dcdec9-54b5-4cc7-955b-0d0ec44a961a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:10.750471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-40dcdec9-54b5-4cc7-955b-0d0ec44a961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:10.796431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89300-67a6-488a-9cc7-d6d367fd9d89 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:10.854581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 209/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:10.861612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:10.862858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.863332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.863791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.873406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32227e-2c85-4b45-9fc9-e2a089295470 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.873960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32227e-2c85-4b45-9fc9-e2a089295470 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.874471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32227e-2c85-4b45-9fc9-e2a089295470 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.876852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 210/422] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:10.883888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:10.884174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:10.884486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:10.912670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:10.913869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:10.948772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:10.993453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.004237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.033710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.051311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 211/423] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:11.157862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.161057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 213/424] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:11.172196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.296903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f8f2f-1c1f-4542-87ec-fe10a497f246 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.316799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.358188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050721d-50de-4095-b0c2-4986172e191a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.365679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.366350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.366629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.366895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.382134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:11.386979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:11.387862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:11.388665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:11.396490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.399313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.400752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.401230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.401728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.403102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.404767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.406907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 214/426] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:11.419167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.456891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.508463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06378f78-8014-468b-ac14-adcfba6b3fd2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.545084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.546026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.546890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.547427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.548281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:11.548774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.550430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.551460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7858e-dcef-4c72-a06c-e86da422fedf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.559913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:11.560944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.593796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.594457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.594732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.594996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.596167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.597705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.604315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:11.605121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.614040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.663827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69a4c-b35c-4faa-ae11-8f8e8db33fc0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.678506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.699595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.700558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.701066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.701526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.712351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:11.715453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4dee1-9bb3-43e8-a9bd-c1cc883c77a5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:11.718078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:11.718978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 14:54:11.719745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:11.722299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:11.723290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.757355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.757968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.758245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.758542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.843519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.845282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.849348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e283-7e7e-4cc9-aa40-d5f2974a1442 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:11.854248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:11.896086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:11.896693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:11.896971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:11.897240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:11.898209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=82cd53828e69487a8918277ec483c67a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:11.898544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:11.900439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:11.910337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 215/430] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=44a03d54df6f4580a9f4933398e65018 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:11.911464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:11.971118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.029754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:12.037129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.128468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effd1-c6ff-44c7-8382-9e4579c7f512 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.197712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.198353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.198616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.198885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.199547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:12.199854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.202456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.212030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.218755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119880b-4382-4ef0-8047-3363342cc62d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.221370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.230281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.271252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.272027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.272234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.272484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] PATH_INFO: `/v3/projects/82cd53828e69487a8918277ec483c67a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.273765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] RBAC: Authorizing `identity:get_project(project_id=82cd53828e69487a8918277ec483c67a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.275820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58c447-2a54-462a-a3e2-36c480f070f4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.278400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 217/433] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/projects/82cd53828e69487a8918277ec483c67a => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.278990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe18d6-7ff3-4ac1-b276-7c98f4c26f32 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.279266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe18d6-7ff3-4ac1-b276-7c98f4c26f32 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.279538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe18d6-7ff3-4ac1-b276-7c98f4c26f32 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.284179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 218/434] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:12.286000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe18d6-7ff3-4ac1-b276-7c98f4c26f32 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.358163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.361360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4fe8-3c02-4ea4-8e8d-86e98c9b1ece None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.411587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.412209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.412598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.412742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.428224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe18d6-7ff3-4ac1-b276-7c98f4c26f32 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.475041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.475680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.475953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.476218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.477344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.479351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175ddcb-31f0-49e4-884c-e94841fb8526 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.480913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 219/435] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.487766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.488317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.488317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.502041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.504403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.509931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:12.512798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:12.555131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.587873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 220/436] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:12.588502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.618226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.626793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 217/437] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:12.631447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.715162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1a89-2aa7-4d18-9ba7-6cdf7b0a215d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.738997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aca84-5a9e-43a2-ad37-b2bbfa73c36d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.761217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.761969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.762337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.762742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.763525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=82cd53828e69487a8918277ec483c67a) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:12.764115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.765425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.771614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 221/438] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=82cd53828e69487a8918277ec483c67a&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.784264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.785252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.785709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.786157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.787655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.789322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41aa2b-a794-4e56-a70d-782793ba531e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.791755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 218/439] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.800196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.837156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.850169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e043f5-d841-4223-a255-fae7bef0cc8c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.850474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e043f5-d841-4223-a255-fae7bef0cc8c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.850747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e043f5-d841-4223-a255-fae7bef0cc8c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.852118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 219/440] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:12.857832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902652f7-49b3-408e-a179-bac05de43939 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.858472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902652f7-49b3-408e-a179-bac05de43939 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.858988 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902652f7-49b3-408e-a179-bac05de43939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.878021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-902652f7-49b3-408e-a179-bac05de43939 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:12.879287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-902652f7-49b3-408e-a179-bac05de43939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:12.916546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314b9b-fe30-4a36-b35f-cfd5625b628e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:12.949469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:12.962817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 220/441] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:12.962817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902652f7-49b3-408e-a179-bac05de43939 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:12.963087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:12.963087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:12.963087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:12.963087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:12.963347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:12.966022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:12.966463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 222/442] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:12.979501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.086319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902652f7-49b3-408e-a179-bac05de43939 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.111503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a490e7-d8bb-4f2f-8cea-7dd73ede9c0c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.115474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.132520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.133245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.133524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.133785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.146889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:13.152753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:13.153640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:13.154484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 221/443] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:13.156281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.156888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.157166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.157438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.158166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=44a03d54df6f4580a9f4933398e65018, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:13.158594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.160034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.162383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.170918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 223/444] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:12 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=44a03d54df6f4580a9f4933398e65018 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:13.236250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.240917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.293359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac13a5-22ed-4b91-9360-c3ee8265863a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.330391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.331002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.331279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.331546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.332213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:13.332515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.333911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.343123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 222/445] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:13.348906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.371199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0faf-133a-4f26-82cd-38519bab04c8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.410677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.411354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.411614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.411890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.426574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:13.434524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:13.435453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:13.436232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 224/446] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:13.442621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.477232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.480631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228abc8-1f22-451b-96e4-38c6ddcd2223 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.504426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.522947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.523702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.523832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.524072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.562621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af7d6-e594-4593-a033-0d7d5b63117b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.598082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.598756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.599034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.599300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.599946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:13.600242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.601641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.604435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.605861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.610039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 225/447] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:13.615810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.702849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 223/448] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:54:13.703567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.708744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.713724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364a3cf-f4f9-4a00-b27a-49fca076b4d1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.728883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.746658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.747269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.747546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.747821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.808018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bdba-237d-4267-8e68-7080e5dcc6e2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.815567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.817017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.842148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.842807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.843083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.843351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] PATH_INFO: `/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.844488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7b06c46a8f40569b4e30f9fe7592c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.845948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.847606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/projects/7d7b06c46a8f40569b4e30f9fe7592c3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:13.853024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.909369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.920383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 226/450] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 14:54:13.925842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:13.937741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:13.950195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f598a-1b9c-48a0-b9df-5f0e86d36829 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:13.987412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:13.988037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:13.988310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:13.988576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] PATH_INFO: `/v3/groups/478c1a0ace894201a90ce4be3f4e3995` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:13.989673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] RBAC: Authorizing `identity:get_group(group_id=478c1a0ace894201a90ce4be3f4e3995)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:13.991153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:13.992696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 225/451] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/groups/478c1a0ace894201a90ce4be3f4e3995 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:13.998563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:14.027052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7ee1-699b-4a83-a512-9100f6fdf904 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:14.060753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:14.061303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:14.061606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:14.061872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] PATH_INFO: `/v3/projects/7334057aea374090aa685d1856ec911f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:14.062994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] RBAC: Authorizing `identity:get_project(project_id=7334057aea374090aa685d1856ec911f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:14.064440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:14.066044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 227/452] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/projects/7334057aea374090aa685d1856ec911f => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:14.071392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:14.100252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca49ab-7500-45ad-b79c-9780a3588689 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:14.128430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:14.134950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:14.135541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:14.135815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:14.136080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:14.136790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] RBAC: Adding query filter params (group.id=478c1a0ace894201a90ce4be3f4e3995, role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:14.137090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:14.138517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:14.144051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 226/453] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:13 2022] GET /identity/v3/role_assignments?group.id=478c1a0ace894201a90ce4be3f4e3995&scope.project.id=7d7b06c46a8f40569b4e30f9fe7592c3&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:14.171898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788e67d-1a56-4ff3-afd9-51fe09b94108 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:14.208904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:14.209533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:14.209806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:14.210070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] PATH_INFO: `/v3/groups/756b886b88524e13a95ad9c350bdc538` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:14.211244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] RBAC: Authorizing `identity:get_group(group_id=756b886b88524e13a95ad9c350bdc538)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:14.212693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d734aa-2156-40f7-93e4-d35359a33eb1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:14.214320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 228/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 14:54:14 2022] GET /identity/v3/groups/756b886b88524e13a95ad9c350bdc538 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:14.220360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:14.243608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:14.323680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1aba0-987e-4cdb-80e8-95a71ff2103b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:14.357981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:14.358610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:14.358886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:14.359152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:14.359866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] RBAC: Adding query filter params (group.id=756b886b88524e13a95ad9c350bdc538, role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=7334057aea374090aa685d1856ec911f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:14.360172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:14.361580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b6fe1-99ad-4cd5-945c-79fc77ec9f6c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:14.367333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 227/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 14:54:14 2022] GET /identity/v3/role_assignments?group.id=756b886b88524e13a95ad9c350bdc538&scope.project.id=7334057aea374090aa685d1856ec911f&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:17.012344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00198-d387-429c-9167-bf232546e1b1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.012344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00198-d387-429c-9167-bf232546e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.012344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00198-d387-429c-9167-bf232546e1b1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.012344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 229/456] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:17.015017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253b18-71ce-40d7-ad7f-fa2de53dd9da None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.015775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253b18-71ce-40d7-ad7f-fa2de53dd9da None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.016235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253b18-71ce-40d7-ad7f-fa2de53dd9da None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.018362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 228/457] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:17.023110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.023703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.024167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.031719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.032032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.032271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.046472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:17.048007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:17.060894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:17.062347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:17.135241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 229/458] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:17.188743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:17.404821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:17.427160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:17.504114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:17.542218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d675011-91ec-419a-86b1-12c24639fed6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:17.599836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:17.603693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:17.604311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.604590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.604861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.617673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:17.620278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-81a324c5-d476-4969-9db3-6e0707b835a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:17.638704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:17.639619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:17.640440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:17.640440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:17.640440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:17.647214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 230/460] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:17.647976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b8f7-3cec-46f9-9b01-5742546bcaf2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.648993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b8f7-3cec-46f9-9b01-5742546bcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.649273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b8f7-3cec-46f9-9b01-5742546bcaf2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.651479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 231/461] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:17.652962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b8f7-3cec-46f9-9b01-5742546bcaf2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:17.668518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b86528-44e4-4fa3-86e7-fa9ae5718b29 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:17.706292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:17.707247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.707850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.708336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.719910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:17.721756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:17.725185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-01489414-f0ee-4134-883b-e4c406aadea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:17.739456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:17.740353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:17.741251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:17.741251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:17.741251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:17.748628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 231/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:17.750490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.750985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.751444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.762648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b8f7-3cec-46f9-9b01-5742546bcaf2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:17.771557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:17.773045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:17.798223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:17.798910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:17.799197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:17.799559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:17.800100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:17.800406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:17.802073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:17.819313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 232/463] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:17.819313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:17.866456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 232/464] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:17.866456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:17.938516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:17.975750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06570231-47e2-4529-9275-0d44b9047aec None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.004390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:18.014139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.014916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.015294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.015812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.016508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:18.016904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.018402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d0d1e-8de9-44b4-b9ca-bf53a8c3f9cc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.030535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:18.031406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d512-70d8-4c67-a4f3-de4a4c8f70a2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.031828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b45c-357f-447d-a0fd-8c2a9834c1f0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.032169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b45c-357f-447d-a0fd-8c2a9834c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.032516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738b45c-357f-447d-a0fd-8c2a9834c1f0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.037837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 234/466] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:18.038652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738b45c-357f-447d-a0fd-8c2a9834c1f0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.075225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.075836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.076117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.076392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.077337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.079525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df845fc-2c09-4ab0-a826-4c677d3d4b68 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.107772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 233/467] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:17 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:18.109621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.109916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.110191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.133675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:18.135448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:18.168891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738b45c-357f-447d-a0fd-8c2a9834c1f0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.244427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.246170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.247368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.247875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.249490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.251839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.262340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 234/468] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:18.262340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.293329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 235/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:18 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:18.304651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:18.395338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1645c-41e5-413c-bcee-0554046a1406 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.439484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.440378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.440800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.441214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.453251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.455105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9cad4672-b0c9-4ffb-8c93-838a4a91b718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:18.472667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:18.473851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:18.475004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:18.475004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:18.475004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:18.477149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 235/470] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:18.483167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.520583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac9c3-a02e-4c98-bb32-022a10d07c9d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.520876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac9c3-a02e-4c98-bb32-022a10d07c9d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.521054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac9c3-a02e-4c98-bb32-022a10d07c9d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.522425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 236/471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:18.530130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.530575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.530851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.533259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:18.556041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:18.557245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:18.617430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064098d-80b3-42d1-b57e-804c863ab7b6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.647059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 237/472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:18.656403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.661298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.661915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.662198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.662502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.663220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:18.663528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.664939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.667681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:18.681020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 236/473] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:18.686388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.762647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc1e99-e819-4e26-b5af-a97439b5f673 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.797479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.798170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.798647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.799030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.809810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820872f5-6586-4387-ad14-8ef070bb7f65 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:18.809998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.811508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.811901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:18.827455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:18.828611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:18.829681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:18.829681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:18.829681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:18.835605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 238/474] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:18.836873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.856967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:18.857574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:18.857845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:18.858098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:18.858797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:18.860436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:18.901945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 237/475] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:18 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:54:18.932766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:18.943137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:19.007690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c22e-b880-43d1-ad30-72cdf88a6072 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:19.047980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0414f-5e73-4d38-9f50-f3a2eb6e3f9d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:19.059887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:19.061731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:19.062175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:19.063044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:19.064192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:19.064651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:19.067118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:19.088778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 239/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:19.094288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:19.103605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:19.104237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:19.104515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:19.104786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:19.105473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:19.108329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:19.122577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 14:54:19.122577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 14:54:19.122577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [parameters: {'id': '452598b47b5249189af6d667333b3bbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 14:54:19.122577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 11 14:54:19.152015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:54:19.152965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 14:54:19.153863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 14:54:19.154745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:54:19.155622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:54:19.156441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'id': '452598b47b5249189af6d667333b3bbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:19.157284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 14:54:19.158077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.161295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 238/477] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 14:54:18 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:19.169421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:19.208020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:19.249482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f904-4fc3-4cad-bbce-35c57868aa47 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:19.268883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:19.288648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:19.289598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:19.290073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:19.290592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:19.291448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:19.293128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:19.296402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c30fd-bd12-46da-90a7-ae42d09151ae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:19.320127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 240/478] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:19 2022] POST /identity/v3/users => generated 249 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:19.343352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:19.344126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:19.344403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:19.344672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:19.357878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5ae694de-98e2-4009-8a5b-bf79ebba9875 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:19.367841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:19.368859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:19.369652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:54:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:19.375475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:19.496291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ae43-751c-4338-9689-9e12799bd9f5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:19.534300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:19.534941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:19.535222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:19.535496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:19.536162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:19.536462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:19.537857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085954e6-3c47-4719-8e70-dabc63b5f176 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:19.547173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 241/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:21.127314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6138d-fcf3-49be-af04-c68ca5cdae0d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.127860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6138d-fcf3-49be-af04-c68ca5cdae0d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.127860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6138d-fcf3-49be-af04-c68ca5cdae0d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.129496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 240/481] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:21.147535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.148048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.148048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.180202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:21.182167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:21.221678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:21.257808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c18b-bcb5-4586-a905-295bf003e2d9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.258190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c18b-bcb5-4586-a905-295bf003e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.258592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c18b-bcb5-4586-a905-295bf003e2d9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.260368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 241/482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:21.265596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.265918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.266281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.268618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 242/483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:21.311235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:21.312424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:21.412759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:21.546181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:21.675836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e52e-660d-4ecc-a999-03da45449055 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:21.728338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:21.728977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.729252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.729521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.743178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:21.748558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:21.749413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:21.750646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:21.755392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:21.755598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:21.779729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:21.804930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:21.897454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaccd9-6616-4b42-90c4-446f8399303f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:21.903304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2f76f-b71c-4071-899a-24b70755f8d7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:21.933512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:21.934172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.934471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.934739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.945292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:21.948708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:21.949390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.949740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.950086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f98faa97-0d89-46a8-a2e3-50472ddfd05d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:21.951143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:21.952000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:21.952801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:21.953395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:21.953395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:21.953511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 243/486] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:21.953975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315377b-a44f-489f-a9b4-55f4e659e417 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.955030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315377b-a44f-489f-a9b4-55f4e659e417 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.955030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315377b-a44f-489f-a9b4-55f4e659e417 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.955211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510b2-c87c-4539-a212-ae4462019622 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:21.956017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 244/487] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:21.960773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315377b-a44f-489f-a9b4-55f4e659e417 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:21.964577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:21.966952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:21.967337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:21.967719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:21.993777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:21.995011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:22.056473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.082465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:22.083661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.100514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315377b-a44f-489f-a9b4-55f4e659e417 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.119849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.176282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.177200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.177421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.177691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.180063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:22.180369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.182588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c9084-e8f1-4d23-9de2-4f9c654a896b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.202369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:22.203848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1be1-fd87-4bed-99fa-356899b7a7d5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.204137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1be1-fd87-4bed-99fa-356899b7a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.204408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1be1-fd87-4bed-99fa-356899b7a7d5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.205807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 246/491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:22.208359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e1be1-fd87-4bed-99fa-356899b7a7d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.239753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581943cd-53b7-43e7-a563-a6218a46f991 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.288539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.289214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.290056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.290387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.306430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.307955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-488600d6-6575-497c-9282-6448d4ca582b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:22.327622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:22.328520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:22.329365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:22.329365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:22.329365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:22.329365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:22.330498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.330778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.331048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.343743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e1be1-fd87-4bed-99fa-356899b7a7d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.353922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:22.355607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:22.383011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.383780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.384185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.384519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.387637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.398310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.400289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:22.414199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:22.415985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:22.416912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:22.416912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:22.416912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:22.416912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:22.416912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.430041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.435315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 247/494] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:22.436145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.523713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3836-60aa-4f9f-b254-be4cd7128c90 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.536133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0be17-a953-40d9-9a7c-a216bb290275 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.561478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.562136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.562454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.562770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.563404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:22.563700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.565072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c92b0-a240-4fb2-a32e-5c93c2fc6af2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.576243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820ba8-585e-4417-b907-826d70838505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.576872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820ba8-585e-4417-b907-826d70838505 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.577034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 248/495] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:22.577187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820ba8-585e-4417-b907-826d70838505 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.577493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820ba8-585e-4417-b907-826d70838505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.579812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c41f-3148-476a-9a6c-2a3cb68a73e8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.580681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c41f-3148-476a-9a6c-2a3cb68a73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.581169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c41f-3148-476a-9a6c-2a3cb68a73e8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.582888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 249/496] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:22.583976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c41f-3148-476a-9a6c-2a3cb68a73e8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.588632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820ba8-585e-4417-b907-826d70838505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-14820ba8-585e-4417-b907-826d70838505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:22.593517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:22.594404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:22.595199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:22.595830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820ba8-585e-4417-b907-826d70838505 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.637908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.659729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.699520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c41f-3148-476a-9a6c-2a3cb68a73e8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.701207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820ba8-585e-4417-b907-826d70838505 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.732754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.733368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.733634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.733906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.734111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.734623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:22.734928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.735022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.735259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.735528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.736280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725276-5f14-4678-9d39-79de509f2575 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.743072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.745617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.747819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:22.749090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.749380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.749650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:22.758930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:22.760036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:22.760935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:22.761502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.767266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:22.768433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:22.835473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 251/500] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:22.836118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.871268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d316-02bf-4e2e-b2f2-170f778b729a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.871436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.892232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:22.908338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.908940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.909213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.909479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.910128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:22.910456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.911830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:22.925674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:22.925674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:22.940012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba5ea-29a6-4263-9c54-3e7ffe5b21da None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:22.979865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:22.979865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:22.979865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:22.979865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:22.992348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:22.994394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:23.008771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:23.009753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:23.010625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:23.010625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:23.010625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:23.010625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 252/502] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:23.010833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.045234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b507b9-72d9-4e50-8902-7fac97bf1c2e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.079673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.080499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.080776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.081045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.088949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.090340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:23.101391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:23.102260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:23.103390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:23.106544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 251/503] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:23.107405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.110984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.123815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af312a7-ed21-4a88-a59b-d3abaa4e48e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.150113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.156986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.157585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.157857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.158128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.158873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:23.159177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.160605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.197623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 253/504] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:23.202735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.206509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d831d2-c780-4b2e-9195-4b9448213696 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.276182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.276812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.277074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.277345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.287730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.289178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.297035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847469d9-05ed-4d18-811e-17da0b61871f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:23.303727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:23.304744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:23.305574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:23.305574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:23.305574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:23.305574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 252/505] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:23.306363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.332881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.333482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.333757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.334025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.334685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:23.334987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.336355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.351855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 254/506] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:23.351855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.356993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.396563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.404427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d910-b881-41f4-8a88-4323d7ed2ab2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.437548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.438167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.438472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.438741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.446206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3b1d-5860-4be4-b63c-2aa5e6bf4322 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.448483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:23.453660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:23.454618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:23.455400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 253/507] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:23.456051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.486274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.486895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.487199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.487466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.488178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:23.488475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.489887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.507205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 255/508] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:23.508201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.557896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3a7e-55bf-4173-80cf-29e90cd035f1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.572152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.590745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.591345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.591619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.591885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.608975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867939-b0c4-4f7c-bf0a-a7440b945634 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.615194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.642020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.642641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.642920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.643192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.643820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:23.644120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.645485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.656860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:23.657614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.663094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.664556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.753291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffeea2-c6c0-40b6-9795-d2d5d662fc45 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.761338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 254/510] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:23.762148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.777665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.788188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.788789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.789066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.789338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.789968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.791463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.812397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 257/511] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:23 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:23.813190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.819040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:23.871499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8573-6008-4def-93b6-ad437134c504 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.916542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.917537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.917819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.918224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:23.919277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:23.919594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:23.921429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:23.927742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b2b-a6e8-4195-9f81-1ddb5e80c0a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:23.938436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:23.938436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:23.964555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:23.965174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:23.965447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:23.965714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.031629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.059295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.060046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2586-2d76-46d3-80ce-60f4ea8f8388 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.060752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.078613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.097952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.098709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.098987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.099258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.108100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.109803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:24.122896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:24.123949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 256/513] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:24.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.176301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 258/514] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:24.176301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.235013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24e7f6-72ee-40d9-98e3-1a599d3926fd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.259406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.270567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.271412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.271839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.272104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.280297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919184f-07a6-4250-a88c-ea669f6dc4a4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.283804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.285274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:24.300116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:24.301046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:24.307594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:24.307594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.307594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:24.307594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 257/515] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:24.307594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.323998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.324632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.324911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.325181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.332857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.336004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.337448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:24.353563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:24.354545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:24.355378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:24.355378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.355378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:24.355378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 259/516] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:24.355378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.412651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fde2-d366-4a31-9879-23282c275243 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.449910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.450545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.450827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.451098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.451824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:24.452135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.453567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.458544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d620-04f9-47ff-97a7-f590300882a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.489512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.496092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 258/517] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:24.496092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.500930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.501559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.501835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.502103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.513414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.514892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:24.529369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:24.530314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:24.536118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:24.536118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:24.536118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:24.536118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 260/518] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:24.536118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.584557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.600718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebc4b4-973d-48e8-894d-745efebc1cdd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.637486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.638136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.638461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.638738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.639380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:24.639685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.641073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.648177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7e23-4b26-46d7-aae8-fff5831c4949 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.653722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 259/519] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:24.655051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.688549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.689073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.689349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.689612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.690248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:24.690591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.691956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.709032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 261/520] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:24.709032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.762370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.768832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772625-5fb5-4f68-95e8-e04c01cf51d2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.801496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.802391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.802683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.802947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.817432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:24.822864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9ce4-c79a-4128-892f-2b803a673713 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.859377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:24.860394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:24.860932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:24.861198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:24.861838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:24.862137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.863542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.873541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:24.875023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:24.880046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 262/521] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:24.880046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.980471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 260/522] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:24.981333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:24.988434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040caf-89de-4069-bed9-4eaf81f0817d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:24.991008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.026548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.027187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.027506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.027734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.034384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.034993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.036737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:25.048844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:25.049740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:25.050964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 263/523] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:25.055534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.094256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f54f-5cca-46c2-b43d-b7b46e7c1465 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.132778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.133404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.133685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.134510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.141594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.143059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:25.154530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:25.155428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:25.156307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 261/524] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:25.156852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.164033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b982-40ad-4fba-b717-b61def274f16 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.199245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.199889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.200165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.200431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.207507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.208927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:25.220674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:25.221554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:25.222438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 264/525] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:25.222897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.250747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.271796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352cb1-f6f5-46f8-b571-48f4a910ac72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.279267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.313855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.314509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.314610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.314929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.325169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.326724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.333411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413792d5-8642-4b12-b96b-cc6f9e7e1b55 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:25.341744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:25.347625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:25.348493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:25.348493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:25.348493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:25.348493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 262/526] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:25.348493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.374498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.375203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.375489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.375762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.376444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.376749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.378175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.395562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 265/527] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.396377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.454803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860ed2-8ca2-4238-820a-ff3dec0c0903 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.489562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.493937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.494758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.494975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.495317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.496051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.496415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.497812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.508906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d075a-2924-4f7e-af12-4cafb626be12 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.519519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.519519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.537910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.548819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.549658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.550225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.550573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.551261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.551570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.553271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.564897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.565711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.632521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b738014-c7f1-4ccd-9c6c-b3d9bd29bd80 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.669115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.669838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.670119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.670429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.671066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.671370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.672523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb8c-f9ff-46f1-b3e9-1026676dfbea None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.672753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.689262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 264/530] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.689262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.712646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.713322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.713666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.714002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.714833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=9dab615c85bb4e50b46a69e92b33963e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.715236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.716728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.730302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/role_assignments?user.id=9dab615c85bb4e50b46a69e92b33963e&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.730302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:25.741351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.791847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:25.824721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c05f-8d3d-421e-90ad-c4cd90964bfc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.858661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd0cf-7274-450c-a190-854d9d71feed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:25.871491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.872327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.872731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.873554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.916080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:25.917370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:25.917888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:25.918448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:25.919228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:25.919658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:25.921226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:25.930505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 268/532] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:25.931679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.028259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.030931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.048033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:26.089716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2c5-1a81-4a93-bb31-c9db04a577e4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:26.137146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:26.137981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:26.139051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.139428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.139920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.148242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.149799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7efc6686-3ead-43c2-84fa-1a4ad9e7c34d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:26.162283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:26.163145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:26.163982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 269/533] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:26.165965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ec1e-fadf-4dcd-8fde-58e72cb50c16 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.166364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ec1e-fadf-4dcd-8fde-58e72cb50c16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.166710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ec1e-fadf-4dcd-8fde-58e72cb50c16 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.167195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 265/534] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:26.169635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.177162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 270/535] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:26.177162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867ec1e-fadf-4dcd-8fde-58e72cb50c16 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.289669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc1e5-21dc-4955-b32e-c2d93ff3f81e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:26.302438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867ec1e-fadf-4dcd-8fde-58e72cb50c16 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:26.334143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:26.345882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:26.346555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.346835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.347105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.368941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.370418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.375115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:26.375733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.376007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.376279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.376965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:26.377269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.378709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f3ba3fb3-84d4-46ad-b0ef-5f1fb13c407a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:26.403182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:26.404125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:26.404954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:26.404954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:26.404954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:26.408576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 271/536] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:26.409815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.410104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.410429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.417067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 266/537] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:26.417764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.447998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:26.449218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:26.497206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:26.578423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 272/538] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:26.578423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.654076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6e6e-d01c-4235-b7aa-e700c2788693 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:26.722773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588afaea-2e7f-4488-a7fd-7e8961a2cafc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:26.743931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:26.785153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:26.789956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.790793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.792378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.793268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2ff83fd91f594d97af82492a1eb344af) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:26.796705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.799295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.817302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:26.821109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:26.822451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:26.824593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/role_assignments?user.id=2ff83fd91f594d97af82492a1eb344af&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:26.827119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:26.831004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:26.831494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:26.833108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:26.876937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 267/540] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:26.887472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:26.979576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.058767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8b93-6a33-479b-8be9-370a64414858 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.101471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.102352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.102840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.103256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.111314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:27.112908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:27.113854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:27.127599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34ec0-a578-49ff-9349-2d37f1b0df6e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:27.141468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:27.142372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:27.143210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:27.145926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 274/541] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:27.152829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.198995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:27.214694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.215336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.215612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.215880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.244601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:27.250904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:27.251781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:27.252557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:27.259261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 268/542] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:27.264143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.273165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedb3e-f991-4715-ab7f-034320aefce2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.318105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.319432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.320133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.320582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.321697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:27.322487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:27.324089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:27.342937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 275/543] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:27.345376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.444406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75614-e8c2-46f7-aacf-970b21776f27 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.501496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.502105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.502411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.502685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.503350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:27.503655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:27.505037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:27.508219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:27.511959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844930-bddc-4ff3-af57-f0f7b100e96c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.528691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 269/544] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:27.534994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.566243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:27.579919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.580536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.580808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.581075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.581803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=05c3fd3f0f2c4c48a9ced12e4ef9f950) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:27.582110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:27.583577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:27.594394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 276/545] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:27 2022] GET /identity/v3/role_assignments?user.id=05c3fd3f0f2c4c48a9ced12e4ef9f950&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:27.721598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95cc6-1a25-4fa6-b6df-b1357f554f32 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:27.780356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:27.781000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:27.781277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:27.781546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:27.796842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:27.798326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:27.813536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:27.814503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:27.815328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:27.815328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:27.815328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:27.815328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 270/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:27.820540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:27.987865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a3ae-5107-4346-bb4d-b0d92f952bda None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:28.043557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:28.044562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.045036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.045503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.046364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:28.046864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:28.048435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:28.065569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 277/547] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:28.070774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:28.173589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:28.216063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aab555-472b-40f6-b9fd-4c7129bbe671 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:28.267205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:28.267780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.268052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.268318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.277289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:28.278801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0aaa442d-f2f1-4e13-ad58-cf372e70a0a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:28.294855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:28.296288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:28.297335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 271/548] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:28.302102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:28.333331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:28.376622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ac51-722f-4d18-ab6c-a5674fe62dc5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.376944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ac51-722f-4d18-ab6c-a5674fe62dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.377217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ac51-722f-4d18-ab6c-a5674fe62dc5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.378753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 272/549] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:28.394612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80710-cf5d-4257-ad52-f65d6bc1ed37 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.394877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80710-cf5d-4257-ad52-f65d6bc1ed37 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.395141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80710-cf5d-4257-ad52-f65d6bc1ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.420429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ea80710-cf5d-4257-ad52-f65d6bc1ed37 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:28.421622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ea80710-cf5d-4257-ad52-f65d6bc1ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:28.457314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5bc2b-2524-4cad-91c6-d63530773307 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:28.496808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:28.497446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.497758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.497982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.498733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:28.499034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:28.500448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:28.506504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 273/550] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:28.508416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d3c2-a3de-4a81-ab4f-321874ddb4ce None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.508973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d3c2-a3de-4a81-ab4f-321874ddb4ce None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.509441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d3c2-a3de-4a81-ab4f-321874ddb4ce None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.511192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 274/551] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:28.519056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 278/552] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:54:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:28.525130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.525416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.525690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.531311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:28.559267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:28.560477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:28.616135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:28.638605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572f387-fc73-4c60-a9b8-b3f4381e6b11 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:28.679039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:28.679687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:28.679959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:28.680276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:28.692978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:28.716371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 275/553] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:28.761089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:28.762650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:28.847265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:28.875241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 279/554] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:28.881368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:28.917316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.053356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4a17-7adf-4fa4-87b3-0649447a1129 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.096926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.098098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.098344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.098880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.107768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728170-1a11-40b8-92a1-4eb14919f173 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.112977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.114491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:29.134457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.135548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:29.136425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:29.136425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.136425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:29.136425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 276/555] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:29.138299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.154171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.155103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.155381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.155658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.169025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:29.175734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.178116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:29.179892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 280/556] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:29.186289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.193253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.240708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.282530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1149-5d30-4956-9f4e-4a904815a535 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.322750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.323755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.324109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.324454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.328975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261e00-902b-4cb1-8b31-9dd454e73775 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.338911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:29.346351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.347938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:29.349550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 277/557] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:29.350892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.370626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.371230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.371508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.371778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.372416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:29.372720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.374169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.386946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 281/558] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:29.387794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.458623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a845a-f710-4cb9-86ec-9a90f81ffd07 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.460091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.494196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.494852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.495128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.495394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.495845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.496333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:29.496333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.497845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efab27-98d4-4967-92df-e1edc41656b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.500097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136be52b-bdc6-40fa-a90c-3164b6dacba7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.506019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 278/559] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:29.507234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239350-87fe-4035-8885-28b95e5d5de7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.507832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239350-87fe-4035-8885-28b95e5d5de7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.507832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239350-87fe-4035-8885-28b95e5d5de7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.513038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 279/560] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:29.513804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239350-87fe-4035-8885-28b95e5d5de7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.542527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.543574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.544002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.544421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.545333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:29.545953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.547346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.556091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 282/561] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:29.556886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.622713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239350-87fe-4035-8885-28b95e5d5de7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.655938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.656570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.656849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.657115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.663798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.664782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a202-e5d5-48b4-b5f9-7c5335c25e58 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.665348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e3a572ac-8344-4654-8783-6230813a0654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:29.677228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.678348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:29.679430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:29.683123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 280/562] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:29.684355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.684642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.684920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.703932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:29.704636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.705117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:29.705594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.706015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.706497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.718167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.720050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.722559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:29.737951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.739163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:29.740243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:29.740243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.740243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:29.741991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 283/563] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:29.743057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.760949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:29.778328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 281/564] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:29.778328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.859649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e05046-6f86-49c9-b1b4-8ffb8caded64 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.898891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.899660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.900005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.900362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.911350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.911561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146e4f-60b2-4069-b837-1e28e1ddc8f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:29.912960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:29.928636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:29.929822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:29.931020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:29.931020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:29.931020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:29.931828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 284/565] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:29.932681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:29.958639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:29.959819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:29.960706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:29.961567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:29.962782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:29.963672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:29.965893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:29.987016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 282/566] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:29.988238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.011486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.015120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.057490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaa48-34fa-4605-966a-ab43480ed582 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.095491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.096252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.096609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.097205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.097669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.098042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.099507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.111898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 285/567] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.112806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.123011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8c7-95a2-4ccb-a546-8458a43144da None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.156612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.157136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.157407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.157673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.158326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.158625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.159984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3eae3-ed63-4980-b64f-73d3077d96cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.171206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 283/568] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.172385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4035-15a9-4abd-a7a4-eb7182e9a465 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.172662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4035-15a9-4abd-a7a4-eb7182e9a465 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.172957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4035-15a9-4abd-a7a4-eb7182e9a465 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.178401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 284/569] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:30.179148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4035-15a9-4abd-a7a4-eb7182e9a465 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.212101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbf24-e02d-4773-b3bd-2df837dcf6ea None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.237740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.247553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.248153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.248432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.248707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.249417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=f8f8f0c6b4b049debb3e963dd3b7916b) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.249729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.251183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.253409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.256715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 286/570] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/role_assignments?user.id=f8f8f0c6b4b049debb3e963dd3b7916b&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.257493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.284472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4035-15a9-4abd-a7a4-eb7182e9a465 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.323623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.324266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.324563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.324826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.336394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:30.341345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:30.342368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:30.343228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 285/571] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:30.343918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.385714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bba8c-6925-4ff3-83a1-2965b13f8d03 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.426063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.426644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.427173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.427440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.435747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.437184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-da851f8d-b9b7-4f7f-998c-90fbef6533f1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:30.450123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:30.451201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:30.452195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 287/572] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:30.453560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.453560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.453560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.471422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0b3bf-7f05-48ec-9d19-ee05e39685f8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.472185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:30.473517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:30.505155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.505786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.506060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.506359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.508238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.514590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.516538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.529026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:30.530737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:30.531639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 286/573] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:30.532607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.557509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 288/574] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:30.563174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.642986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773092c8-07e0-490a-a4c8-cd63f9ee2f4e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.679115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.679717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.680143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.680558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.681858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.682393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.684030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.692677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 287/575] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.693695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.706379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c942836-426e-45d1-976b-ab4f127ccbf5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.756480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.756849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.757129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.757393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.758126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.758465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.759953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.773046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.784244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 289/576] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.785131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.826846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:30.839094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddce1d-85db-4bca-9d24-85fe66d635ad None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.877110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.877717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.877995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.878301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.879002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:30.879305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.880800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.894231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0755-f150-4421-a929-a247e3488527 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:30.899747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 288/577] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:30.900466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:30.934808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:30.935464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:30.935751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:30.936023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:30.946605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:30.948130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:30.964078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:30.965213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:30.966222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:30.966222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:30.966222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:30.966222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 290/578] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:30.970436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.009048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55742f-06a7-4509-bcdf-ed92b0e003d9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.023953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.046400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.047033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.047310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.047581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.058774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.060700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.073196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:31.076661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.077752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:31.078833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:31.078833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.078833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:31.080341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 289/579] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.085117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.086461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a826-7e6f-460d-9e31-3ab4e4e631c1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.123035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.123662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.123935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.124199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.135454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:31.140852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.141882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 291/580] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.143230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.201212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0396-ba1b-4814-9b45-a40cbeccbadd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.236833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.237454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.237728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.237993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.248103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.249543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.249664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b72d-8fac-4681-bd94-ebe851bcf8c4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:31.264020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.264940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:31.265837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:31.265837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.265837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:31.265837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 290/581] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.266709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.287867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.288461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.288737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.289001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.289624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:31.289801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.289974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.291351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.304818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 292/582] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:31.306084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.318643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.373568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfc2bb-fcb5-4089-9302-ab5d9a44d28c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.405188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.405787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.406059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.406344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.406970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:31.407272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.408639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.416592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b2c-39ad-4b9f-92d2-4c0c68c7f593 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.420438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 291/583] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:31.421208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.454440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.455511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.455966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.456238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.456892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:31.457194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.460208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.473678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 293/584] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:31.473678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.501844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.523894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d313d-dd86-4ca6-8ded-c7a0c53405bf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.547555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.561289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.561901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.562174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.562484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.563123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:31.563422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.564784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.580774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 292/585] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:31.580774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.586281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e418b-2088-4c24-af1e-0198128822a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.620971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.621589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.621864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.622132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.629497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.630930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:31.641720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.642666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 294/586] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.643602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.685934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e39da-e266-45a8-95b3-2461033d12d6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.720668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.721319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.721692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.722408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.729875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.731412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.733321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:31.745667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.746865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:31.747954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:31.753533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 293/587] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.753658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fddb-8d8e-4d90-a53c-3e10c79b2cad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.753750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.786729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.793748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.794433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.794764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.795036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.807313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.808750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:31.824176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.825229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:31.826180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:31.826180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:31.826180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:31.826180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 295/588] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.826180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.864241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00877-3504-4486-b75b-3ff97a80ff23 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.897895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.898558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.898845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.899081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.907086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.908527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:31.920050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:31.921098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:31.922167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:31.925665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 294/589] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:31.926482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:31.938726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439999-ae9e-44c8-b48e-5c441d78a944 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:31.984353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:31.984933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:31.985212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:31.985479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:31.986203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:31.986584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:31.987760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:31.988000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.005966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 296/590] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.007133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.036228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ed558-d32d-49ef-86c9-7d406aaecd16 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.055654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.073052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.073658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.073931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.074419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.074902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:32.075200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.076667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.088853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 295/591] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.091592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.120653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85955f-2821-4417-ac07-e5656c72f988 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.161606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.162842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.163292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.163574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.164247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:32.164556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.166023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.182444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 297/592] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.182444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.195619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6a8e-7244-4a7d-9958-e7cbfb2611be None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.216919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.231529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.232175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.232407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.232676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.233367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:32.233669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.235128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.247162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 296/593] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.247951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.294758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e486adc-a2e3-40b8-bdb0-0f3c896179cf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.297031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.332260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.333031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.333305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.333574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.346947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.348640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.358332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c391f4-cafa-4cc1-8b1d-a02b1908d614 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:32.362860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:32.363785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:32.364649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:32.364649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:32.364649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:32.366620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 298/594] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:32.367646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.395356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.396292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.396752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.397073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/9dab615c85bb4e50b46a69e92b33963e/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.412344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=9dab615c85bb4e50b46a69e92b33963e, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.413773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.428602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 297/595] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:32 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/9dab615c85bb4e50b46a69e92b33963e/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:32.429799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.467320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.493742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09874-80c1-47c8-ab62-eaf8c3ea3005 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.535063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.535587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.535863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.536133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.544552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.546024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.552177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600537-4de2-4da4-88b7-6200d3d3eeb6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:32.559275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:32.565236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 299/596] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:32.566158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.581857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.601680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.603094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.603766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.604598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.621384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=456e7e3006f14407ac65e432ace7286d, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.622911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f345455-2e91-44d0-a7d2-f306b2de8c9b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.642966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 298/597] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:32 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:32.644144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f692ea-62f9-4eaf-80d7-088918192749 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.644478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f692ea-62f9-4eaf-80d7-088918192749 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.650304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f692ea-62f9-4eaf-80d7-088918192749 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.651927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 299/598] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:32.652522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f692ea-62f9-4eaf-80d7-088918192749 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.693910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebfbd1-ab9c-4b35-bc3c-09bb82e29fed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.745284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.746186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.746902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.747341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.748168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:32.748884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.755108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce73bfe-9095-4be5-a2e2-45358206d146 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.765606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:32.770813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 300/599] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.775074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.775574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.776396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.796573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f692ea-62f9-4eaf-80d7-088918192749 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:32.802847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:32.804343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:32.841577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:32.841577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:32.841577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:32.841577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:32.842036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:32.842167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:32.843876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:32.866367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 300/600] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:32.867088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.898290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:32.898900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:32.902237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.000059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7249-a567-45ec-9128-6c39e34ab692 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.069039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79549a86-b6bb-4939-ad22-07f8a1b082cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.079049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.079840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.080221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.080584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.088634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.098144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.099668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:33.121815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:33.123507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:33.125227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 301/602] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:33.133848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.140317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.141188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.141614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.142029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.165453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.167392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:33.196852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:33.198023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:33.199150 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:33.199150 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:33.199150 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:33.203273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 302/603] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:33.204261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.278162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.302393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142dcf4-cb8a-432b-83c2-58e2a1890829 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.342571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244249-ddb5-496c-8e00-de3298c0ca02 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.349391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.350426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.350873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.351884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.353378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:33.353843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.356669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.376215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 302/604] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:33.377980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.383680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.384457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.384837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.385210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.397593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:33.404058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:33.405214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:33.406294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:33.408733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 303/605] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:33.409998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.457787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.509505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0d56-927f-40f5-8f76-fba8b5e1b0b4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.538792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c5156-70f3-4d0e-8f8b-46d4829b2338 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.544650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.545374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.545796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.546163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.546974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:33.547369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.548942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.561579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.563004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 303/606] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:33.564079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.584414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.585409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.585863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.586410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/2ff83fd91f594d97af82492a1eb344af/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.604274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=2ff83fd91f594d97af82492a1eb344af, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.606018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.623354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 304/607] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:33 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/2ff83fd91f594d97af82492a1eb344af/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:33.624689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.720085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186ac3-f740-406e-8cf8-171f8a254838 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.758079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.795298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.797825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.798347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.799690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.800579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:33.803076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.804718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.817513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 304/608] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:33.827142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6d4c-ca7e-42c7-a332-c7506c323e30 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:33.827660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.866853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:33.867576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:33.868608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:33.868989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:33.875887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:33.877412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:33.890210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:33.891364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:33.892333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 305/609] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:33.897536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:33.951242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:33.992312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f2ac-9995-4640-a5a0-cb9e24a8b3ee None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.065995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.066983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.067412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.067830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.090564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.093246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.101648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f458d3-43c8-4c1d-9c09-d1317b674c6f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:34.125974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:34.127177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:34.128266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:34.128266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:34.128266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:34.135421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 305/610] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:34.143784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:34.178062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.181533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.181973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.182420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.183276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:34.183949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.185539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.203185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:34.209165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 306/611] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:34.213739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:34.309518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349187-d96c-4597-9e42-951e77ed42d2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.363089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.363620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.365251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.365529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.366175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:34.366500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.371529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.394814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 306/612] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:34.396081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:34.400556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:34.418767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf531b-817f-491f-a40b-2f0ad8f3bae1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.456835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.457501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.457773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.458113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/05c3fd3f0f2c4c48a9ced12e4ef9f950/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.475127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=05c3fd3f0f2c4c48a9ced12e4ef9f950, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.480289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.500777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 307/613] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:34 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/05c3fd3f0f2c4c48a9ced12e4ef9f950/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 14:54:34.578428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:34.594550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ae0d5-d0b3-4042-8f7f-7d1eacabd6c2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.647128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.647789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.648067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.648336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.657248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.658731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8c41ffe9-2e20-4e97-a7cd-fcb3d5aee8ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:34.674016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:34.675054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:34.676755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 307/614] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:34.682788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:34.837912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68441-39c2-492d-b925-18bab1201ac0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:34.859317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f79f-fee2-45ba-a5bf-4f1dd4a5c910 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.859640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f79f-fee2-45ba-a5bf-4f1dd4a5c910 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.859863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f79f-fee2-45ba-a5bf-4f1dd4a5c910 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.861196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 308/615] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:34.867741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d68b0-c157-4a8e-983b-4978e9936449 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.868541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d68b0-c157-4a8e-983b-4978e9936449 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.868813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d68b0-c157-4a8e-983b-4978e9936449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.880352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:34.881010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:34.881289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:34.881559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:34.882293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:34.882616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:34.884627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:34.888384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:34.896048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0f1d68b0-c157-4a8e-983b-4978e9936449 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:34.897839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0f1d68b0-c157-4a8e-983b-4978e9936449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:34.904603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 308/616] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:54:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:34.913116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.033946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edc89-fcd6-422b-8032-4500a47ec87b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.077496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.078135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.078445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.078717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.088509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 309/617] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:35.095637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:35.095922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a09e-9409-4a7f-b96d-d4403c982e50 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.096216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a09e-9409-4a7f-b96d-d4403c982e50 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.096486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a09e-9409-4a7f-b96d-d4403c982e50 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.097102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:35.098185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 310/618] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:35.103593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.104023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.104445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:35.122471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:35.123623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:35.124772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:35.124772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:35.124772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:35.124772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 309/619] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:35.129126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.147360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:35.148619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:35.182361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:35.241475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e64c6-ad10-45a9-b31b-a071be5835c9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.286927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.287589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.287864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.288129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.288799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:35.289124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:35.290547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:35.305080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 310/620] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:35.307213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 311/621] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:35.311300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.408412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.422485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:35.460940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560f32-9396-4afb-9a6c-40b17e221f70 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.480587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:35.539303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.540041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.540320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.540586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.554720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:35.556700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:35.583212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:35.585278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:35.587422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 311/622] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:35.593985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.604041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377acea1-d1cb-4ac8-a0ff-c72396ca91d5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.641339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.642421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.642983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.643575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.655492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:35.660885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:35.661807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:35.662666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:35.665505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 312/623] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:35.666649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.710733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b1c7c-3993-43ef-8fa3-7a3cf24379ad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.752079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.752688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.752965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.753250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.753978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:35.754383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:35.755757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:35.755868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:35.779813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 312/624] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:35.779813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.804170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cae97-6213-431b-8e2d-431f15cb67e5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.812520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:35.843678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.844750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.845215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.845791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.857672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:35.862960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:35.863891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:35.864717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:35.872697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 313/625] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:35.873884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.893966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5947-e606-4837-a934-accc3463bf4f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:35.934882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:35.935412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:35.935693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:35.935968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:35.936702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:35.936922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:35.938305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:35.947707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 313/626] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:35.949018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:35.995527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76ea5-7d06-45c2-9c96-6f30497d84b1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.027550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.035434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.036372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.036842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.037302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/f8f8f0c6b4b049debb3e963dd3b7916b/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.044715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.056659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=f8f8f0c6b4b049debb3e963dd3b7916b, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.058513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.059181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307acb30-0682-4f98-abf7-f34c2a1e4fc6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.082556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 314/627] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:35 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/f8f8f0c6b4b049debb3e963dd3b7916b/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:36.084123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.102884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.102884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.102884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.102884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.103317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:36.103317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.104046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.113604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 314/628] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:36.130394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.245904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489020-0d22-4288-8eff-586c9455f4a4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.296399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.297652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.297927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.298468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.310571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2656a3-00bc-4583-a2f0-c1de233e7a1e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.313953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.317354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d5ba740a-de46-4f67-8e52-05c99186a3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:36.332277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:36.333227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:36.334107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:36.334107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:36.334107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:36.334107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 315/629] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:36.335260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52338d-60d1-4235-8a7c-5e27a03e127f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.335260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52338d-60d1-4235-8a7c-5e27a03e127f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.335260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52338d-60d1-4235-8a7c-5e27a03e127f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.338340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 316/630] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:36.339585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52338d-60d1-4235-8a7c-5e27a03e127f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.357108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.357750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.358028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.358320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.372043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.373464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.379643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c0fab37a-068e-484d-ba53-f943b0cb1c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:36.395478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:36.396482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:36.397365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:36.397365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:36.397365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:36.397542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 315/631] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:36.403321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.403603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.403876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.412141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.427558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:36.428740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:36.473437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52338d-60d1-4235-8a7c-5e27a03e127f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.510441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 316/632] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:36.511244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.515675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.516285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.516559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.516822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.517458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:36.517752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.519153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.546100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 317/633] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:36.549394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.680286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a193d35-a5b6-4c95-931c-6cc5544e8cfc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.722688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.737883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:36.746227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb69d-f6c2-411e-b447-c10da4d6a175 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.747528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.748884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.749556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.750442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.751532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:36.752047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.753707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.769567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 317/634] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:36.777716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.813598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.814234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.814633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.814897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.822458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.823900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:36.835887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:36.837425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:36.838446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 318/635] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:36.839045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.902126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1447-88c1-4bbf-8fbf-e593c523aa1a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.944355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604835a9-61fd-47a8-9bb5-cd96c1940c3a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:36.946007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.947848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.948356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.948847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:36.959559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:36.962317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:36.978189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:36.979245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:36.980194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:36.982969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 318/636] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:36.984156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:36.997646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:36.998406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:36.998686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:36.998953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.011989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:37.017415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:37.018496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:37.019339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 319/637] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:37.020073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.036255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.064568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.125667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fddbdb-3860-4956-89a7-dbbc961cb815 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.131494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e157c6-3295-4648-bbf2-4458bce04d1a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.162116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.162743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.163018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.163277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.163989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:37.164287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.164388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.165487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.165769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.166042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.166244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.166795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:37.167102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.168536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f5b44-d395-428b-87f1-85f8138eb813 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.192995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 319/638] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:37.193226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 320/639] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:37.193226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7c5f-6b93-44f5-934c-edb36cff31b7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.193226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7c5f-6b93-44f5-934c-edb36cff31b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.193226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7c5f-6b93-44f5-934c-edb36cff31b7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.193226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 321/640] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:37.193613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.193695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7c5f-6b93-44f5-934c-edb36cff31b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.270506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.301662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccfe3-262a-4edf-88fc-6cb9781faba5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.308379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7c5f-6b93-44f5-934c-edb36cff31b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.312826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.337577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.338178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.338488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.338764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.339416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:37.339718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.341078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.349681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 320/641] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:37.350489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.355687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.356294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.356568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.356834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.426603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.428489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800a9d5-2e4d-435c-b8c6-cc30aabc9873 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.459883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257233-d095-4d99-adee-72d4b32ad69d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.494400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.495008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.495290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.495562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.500520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.538752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 322/642] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:37.540557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.541602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.541882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.542206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.560901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:37.562085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:37.570774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.572789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.628828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 323/643] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:37.630063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.689977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 321/644] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:37.690921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.766014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.773896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:37.779808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce1d03-e962-4282-8e20-b53433ed498f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.797421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2281c0-7fa6-46fe-9f93-02aa2bb1afd6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.825926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.827173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.827908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.828401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.833284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:37.833908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:37.834184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:37.834555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:37.842403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.844896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.845355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:37.846809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:37.860765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:37.861798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:37.862745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:37.862745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:37.862745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:37.866545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 324/645] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:37.867374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:37.868659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:37.869543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:37.871191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:37.871191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:37.871191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:37.873811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 322/646] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:37.875019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:37.987509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63160-9c6e-4010-b38f-668c8030d76a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:37.999825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a342a9-ce4b-481d-83ee-01f80d3b388b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.013822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.027518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.028157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.028437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.028709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.029464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.030000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.031297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.034587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.035219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.035493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.035761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.045827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 323/647] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.046681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.052360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.053759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:38.067894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.068860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:38.069757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:38.069757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:38.069757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:38.073893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 325/648] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.074721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.078202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.162189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be650c-c837-4fea-bb9f-32d3306345a1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.174892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ff50-cab4-4101-a53b-b7b1287d488c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.197706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.198338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.198623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.198892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.199522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.199822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.201193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.212683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.217282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 324/649] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.217394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.217394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.217578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.217666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.228807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:38.234152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.235114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:38.235938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 326/650] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.236634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.275388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.305830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.334243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c1f03-de3b-4e67-9279-648a99520809 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.351300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330f780-7383-4f6f-a30a-1101ed786f26 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.373146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.374195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.374511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.374790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.384193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.385624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.388512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.389127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.389406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.389829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.390504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.390811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.392177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:38.398707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.400171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:54:38.401327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:38.403165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 325/651] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.404255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.409699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 327/652] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.410734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.511659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d97409-27b0-4655-8aad-0268e46720e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.512127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257be84-c2e9-4aa5-9efa-1ed50d3dee77 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.513881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.535053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.546219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.546407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.546879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.546976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.547152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.547244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.547418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.547517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.548103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.548398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.549760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.554255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.555721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.558042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.558649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:38.566991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.568006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 326/654] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.568926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.661155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aab53-7715-47f7-8c28-d6d707725130 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.665449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273c72-50ca-4c06-9142-bb1f1c598366 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.694978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.695575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.695851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.696118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.696828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.697129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.697886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.698560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.698679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217619-3bc3-4d42-b8f9-ff29a0cc8795 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.698841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.699112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.705750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.707188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.715275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 329/655] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.716449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf223-85a1-4175-96ec-a22acd5dd7b7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.716730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf223-85a1-4175-96ec-a22acd5dd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.717001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf223-85a1-4175-96ec-a22acd5dd7b7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:38.718064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.723103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:38.723981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:38.724409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 330/656] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:38.724409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf223-85a1-4175-96ec-a22acd5dd7b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.724546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 327/657] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.724546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.749232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.769082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.830454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dce78-9cfe-4bc3-adec-8495ccc22f57 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.838762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf223-85a1-4175-96ec-a22acd5dd7b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.862738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.863332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.863602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.863874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.864543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:38.864841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.866254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.871170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:38.871787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.872060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.872324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.877802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 328/658] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:38.878617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:38.882559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:38.884540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f993762a-4175-47f0-a73b-51edcb149f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:38.898676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:38.900902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 331/659] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:38.902765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:38.920019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:38.921193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:38.968877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:38.986338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250a3f-8050-46b9-9cf9-c7452ab60278 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:38.989095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 332/660] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:38.989940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.018031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.021527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.022261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.022632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.022968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.090256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.091656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.098851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd56572-eece-4bde-9259-47d2651b8f6d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.135240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.136116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.136670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.137088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.138085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.138568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.140294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.156475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 333/661] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.158018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.189494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.209283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 329/662] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:39.210461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.253210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.268527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9dea1-c453-43c0-9c27-f2ff451b02b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.301342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.302205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.302507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.302768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.303478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=9dab615c85bb4e50b46a69e92b33963e) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.303778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.305723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.311388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 334/663] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/role_assignments?user.id=9dab615c85bb4e50b46a69e92b33963e&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.312141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.318365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146db0-8b99-4296-9b20-a43c6c3ebc62 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.362384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.362939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.363330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.363606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.364384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.364695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.366102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.382018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 330/664] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.383084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.423995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16246-d7b6-405a-bce5-9253b6fd5ea4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.434015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.464502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.465149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.465425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.465693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.466460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.466769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.468228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.482787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 335/665] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.484925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.502576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.502810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b92d-fbf6-4309-895c-cea636b8daae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.554765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.555481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.555754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.556593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.571476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.572945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:39.592746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:39.593750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:39.594659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:39.594659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:39.594659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:39.596521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 331/666] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:39.597451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.623901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a30-a93c-42d8-8cce-17e0e585b102 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.664727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.665355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.665737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.666002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.678537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:39.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:39.685008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:39.685822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 336/667] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:39.686538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.727611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.735339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef909b3-ef3c-4e9d-912b-f269307eff4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.777280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:39.783380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.784021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.784300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.784573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.793688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.795180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:39.808366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:39.809323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:39.810458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 332/668] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:39.811565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.813357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5802-28dc-4501-9d91-9809dd2bcf20 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.854037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.855865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.856286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.856694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.857921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.858469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.860663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.879459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.880524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.925269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825daa8f-922d-41ae-a5e5-e30c68c9b526 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:39.962702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:39.963306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:39.963579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:39.963845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:39.964497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:39.964795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:39.966143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:39.974985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 333/670] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:39.975755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:39.999628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.019616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ba67-315b-476c-89bf-c1b86e234b10 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.057472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.058074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.058376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.058645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.059450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:40.059646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.061173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.062745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.080317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 338/671] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:40.081142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.108820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e14b9-08ff-4a34-ae1a-d07cd613c349 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.159859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.160862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.161336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.161797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.171334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.173481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.187361 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befabf68-26dd-4c66-a8d5-976497db8162 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:40.189256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:40.190216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:40.191112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:40.192725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 334/672] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:40.192725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.226078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.226798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.227819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.227927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.238355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.240250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:40.257373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:40.259060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:40.260153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:40.260153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:40.260153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:40.261562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 339/673] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:40.262464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.299803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.310369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.330397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6efc-b9aa-4c49-970b-7e2ededab713 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.369453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5034938-c771-45da-975b-fce2719d98ae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.377209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.378802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.379230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.379664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.407699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.408507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.408898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.409321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.410491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:40.410491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.412091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.425348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 340/674] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:40.426288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.468884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.471193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.543287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0fa4a-917a-4848-a374-0a87329e4f90 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.547815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.564426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.592296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.593119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.593549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.593949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.594746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:40.595167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.595386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 335/675] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:40.596342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.596989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.611998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 341/676] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:40.613490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.713583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8bef5-5630-499d-b770-88e75830d6cc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.732398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877afb2-4dff-4803-b9f3-c487d17af917 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:40.756478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.757768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.758191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.758945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.759805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2ff83fd91f594d97af82492a1eb344af) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:40.760383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.762590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.771021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 336/677] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/role_assignments?user.id=2ff83fd91f594d97af82492a1eb344af&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:40.771993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.781095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:40.785271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:40.785811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:40.786221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:40.810777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:40.813556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:40.840753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:40.841957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:40.843039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:40.843039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:40.843039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:40.851142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 342/678] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:40.856730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:40.871045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.896097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:40.993215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103858c-c686-4ce4-aed7-c2e090ea484b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.029444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.030053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.030353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.030626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.031260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:41.031653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.033023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.049788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f77e5-6721-4d6f-8a23-b102abdc3ae6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.050338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 343/679] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:41.055054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:41.095858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.097075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.097588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.098048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.109465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.111584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:41.126412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:41.127565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:41.128715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:41.136283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 337/680] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:41.137682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:41.182663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:41.227606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739ed4-a922-4d35-be06-7cd0c26a058f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.306831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.307383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.307657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.307925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.314936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdd39d-ff95-4693-9aee-e708433b5afa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.316903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:41.327491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.328969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:41.352233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:41.353183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:41.354050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:41.355141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 344/681] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:41.360840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:41.363081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.364387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.366601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.367103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.368611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:41.369305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.371810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.406531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:41.412607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:41.560660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868cab-413f-4e10-803c-1747c9f49986 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.606000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd10b-468a-4924-a8cf-1e57d88111e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.622073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.622725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.623005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.623277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.623973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:41.624282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.625966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.628810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:41.648261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.649823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.650324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.651018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.652917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 345/683] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:41.660598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:41.721682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:41.807348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.808834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a17c3-a31b-42cd-b985-c97bb3817119 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.828534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ece8d-9df1-4f25-8e30-c85036c775a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:41.872186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:41.872832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.873103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.873378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.874126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=05c3fd3f0f2c4c48a9ced12e4ef9f950) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:41.874536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:41.876041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0d8f4-d090-443f-a704-6af7c0728e45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:41.883078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 346/684] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/role_assignments?user.id=05c3fd3f0f2c4c48a9ced12e4ef9f950&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:41.890641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3efe6-5459-4f60-ad83-a900b4face15 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.890997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3efe6-5459-4f60-ad83-a900b4face15 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.891274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3efe6-5459-4f60-ad83-a900b4face15 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.893019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 347/685] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:41.904304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec13d8-bf7d-4f8c-9c1e-9cfce6b12d4f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.904615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec13d8-bf7d-4f8c-9c1e-9cfce6b12d4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.904850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec13d8-bf7d-4f8c-9c1e-9cfce6b12d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.942531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-03ec13d8-bf7d-4f8c-9c1e-9cfce6b12d4f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:41.943746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-03ec13d8-bf7d-4f8c-9c1e-9cfce6b12d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:41.963905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 339/686] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:41.965229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085dba5-fda9-4140-b8b3-5382d18b64cf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:41.965510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085dba5-fda9-4140-b8b3-5382d18b64cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:41.965780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085dba5-fda9-4140-b8b3-5382d18b64cf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:41.967297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 340/687] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:41.969049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085dba5-fda9-4140-b8b3-5382d18b64cf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.032674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.048113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 348/688] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:42.050882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.051311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.051719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.053702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.079237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:42.081395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:42.102800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085dba5-fda9-4140-b8b3-5382d18b64cf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.146014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.147377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.147739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.148107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.161149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.163356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.172023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 349/689] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:42.183296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:42.184417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:42.185486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:42.185486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:42.185486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:42.186865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 341/690] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:42.192235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.299354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62357d8-2c0c-49ff-b1d8-05dbb42a9cfb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.321137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.342833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.343732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.344218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.344684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.345512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:42.346024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.347611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.363402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 350/691] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:42.369363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.403156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.511054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9996-3cb2-45d1-8c79-968c544bbdf9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.524875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.548620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897da23-54b1-430f-86e6-7c691a129e7a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.550492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.552437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.552892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.553306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.562510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.564410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:42.577112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:42.578225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:42.579330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:42.581683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 342/692] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:42.582670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.595276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.596084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.596430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.596772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.608936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.610531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:42.625897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:42.626895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:42.628737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:42.628737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:42.628737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:42.632001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 351/693] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:42.632857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.669161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.702680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067c63-1b7a-4e4a-affa-592acc42bfdc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.748628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.749630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.750147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.750773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.757250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6062-543b-466e-8b0e-5cf2bfc679ab None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.762946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:42.768867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:42.769833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:42.770698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:42.773719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 343/694] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:42.775261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.796871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.797479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.797754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.798030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.798755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:42.799054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.800633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.819349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 352/695] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:42.819349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.822908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.897693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64347-f23a-4564-b871-444a56e233f8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.917017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:42.926737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956429-b6b9-4114-9229-455081e24c41 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:42.937036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.937648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.937929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.938201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.938869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:42.939174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.940656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.954104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 344/696] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:42.955334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:42.967623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:42.968711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:42.969190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:42.969657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:42.970590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:42.971142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:42.972996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:42.987956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 353/697] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:42.989239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.058329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:43.068565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea17f7-8662-4c81-9d9c-372fd1390e11 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.105558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76876312-7347-4eaf-a772-da03976776d3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.108006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.109320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.109320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.109320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.110135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=f8f8f0c6b4b049debb3e963dd3b7916b) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:43.110540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.112042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.126468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 345/698] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:42 2022] GET /identity/v3/role_assignments?user.id=f8f8f0c6b4b049debb3e963dd3b7916b&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:43.127611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.146101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.147194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.147675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.148216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.149785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.151606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf621ff5-a80b-45a9-90d5-9e77298deb5d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.180092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 354/699] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:54:42 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:43.183778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdb51-25f1-4107-8d7a-ad06e60242e7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.184092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdb51-25f1-4107-8d7a-ad06e60242e7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.184323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdb51-25f1-4107-8d7a-ad06e60242e7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.186060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 355/700] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:43.191875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.192190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.192423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.215771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:43.217803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:43.222701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:43.320328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee321-596d-4646-a895-ed7f81be60f3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.373408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 356/701] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:43.381050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.381676 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.381950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.382218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.393398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.394908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:43.415457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:43.416462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:43.417376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:43.417376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:43.417376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:43.419221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:43.430852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.535590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cbe42-b899-4539-9bee-964c2beb2b13 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.579057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.580049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.580541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.581053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.581901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:43.582488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.584069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.594670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:43.598974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:43.604433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.621596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:43.729839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.737433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169276-7038-4aa1-b9b0-3c801f321ed7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.778120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.778944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.779168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.779444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.787675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.789129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:43.801261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:43.802526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:43.803486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 347/704] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:43.814295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:43.903206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf97bb-191d-41fb-80e2-0daeb16926a7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.910567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:43.949384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:43.950049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:43.950295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:43.950578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:43.951158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:43.952924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:43.969626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:43.970719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:43.971562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:43.979171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 358/705] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:43.979321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db195ae-9086-4377-8adc-5674321d0637 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:43.984959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:44.018368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.018969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.019243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.019513 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.020227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:44.020523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.021999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.043713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 348/706] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:44.052515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:44.121822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:44.170652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047807f-d772-45ab-8bed-8cd17967172f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:44.200607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:44.202421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411df5-50d5-448b-b82a-bbfbdac63c9d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:44.211207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.212488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.212764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.213027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.279562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.280109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.280388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.280661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.281305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:44.281611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.283047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.287665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.289163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.295780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 359/707] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:44.301208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:44.403548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 349/708] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:44.414028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:44.484149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:44.501409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e008d-2c3b-4390-8abd-55c8ebbe0bc9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:44.559917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:44.575937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.576576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.576859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.577131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.577789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:44.578096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.579543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301a298-fef9-421a-9b4b-2fea5d8c36b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.597312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 360/709] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:44.630315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b520-1853-4d25-addf-5bb0897df1fd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:44.681750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.682430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.682772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.683051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.694322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.696436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.702911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda1b8-a0d7-4622-a333-7a6c5cd5596f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.703219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda1b8-a0d7-4622-a333-7a6c5cd5596f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.703450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda1b8-a0d7-4622-a333-7a6c5cd5596f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.705158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 361/710] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:44.710616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.710902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.711163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:44.713461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:44.715773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:44.717878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:44.717878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:44.717878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:44.717878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 350/711] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:44.722294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:44.734304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:44.735535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:44.812319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 362/712] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:44.825017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:44.852994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5d98-13ff-4940-8fa6-276f001e18f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:44.890465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:44.891071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:44.891351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:44.891625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:44.892267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:44.892571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:44.893934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:44.907199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 351/713] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:44.912668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.044961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af0630-f92a-4b2f-bf35-dae94862165d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.079958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:45.095521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.096151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.096421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.096688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.107441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.108873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:45.120500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:45.122676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:45.124802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 363/714] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:45.127621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.128868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.279765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca99f-7162-44f8-83cc-cadd2bf43059 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.321638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549c07-f47c-41a4-8741-202ac0ba8e9d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.338449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.338987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.339262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.339530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.340216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:45.340516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.341936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.354628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:45.367176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 352/715] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:45.371166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.381908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.382579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.382862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.383205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] PATH_INFO: `/v3/services/network` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.383794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.385164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:45.399485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:45.400510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:45.401668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 364/716] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:45 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:45.407560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.489987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:45.553363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78076-cee6-4a8b-9b26-867bb071b3bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.587978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5306-777e-4d5c-9bc1-aa5703a0a455 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.618325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.618861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.619137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.619404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.620126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:45.620437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.621859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.632125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 353/717] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:45 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:45.641227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.641854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.642136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.642442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.643091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] RBAC: Adding query filter params (name=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:45.643396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.644806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e72a-eed8-40e9-bc7c-2a03b8875403 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.652594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 365/718] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:45.659520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:45.744528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:45.813341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35354-3785-4789-b4c0-9c8628b23040 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:45.854764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:45.855386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:45.855732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:45.855995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:45.856555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:45.856857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:45.858860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d147c-e2b3-46ad-bed2-113d3d94bf83 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:45.865921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 354/719] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:46.011156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0736-a752-4eb1-8435-67c9c1cf7d25 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.011518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0736-a752-4eb1-8435-67c9c1cf7d25 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.011695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0736-a752-4eb1-8435-67c9c1cf7d25 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.013488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 366/720] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:46.019279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.019585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.019910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.028689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244803-4e9b-4da8-aede-cf0b07e8980e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.028994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244803-4e9b-4da8-aede-cf0b07e8980e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.029238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244803-4e9b-4da8-aede-cf0b07e8980e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.031080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 367/721] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:46.038239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.038567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.038843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.049799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:46.051041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:46.077904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:46.079148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:46.152504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 355/722] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:46.221111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 368/723] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 14:54:46.457136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:46.535227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:46.596289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:46.600448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0f6de-f449-40f3-a64f-8a25e55f9d1c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:46.644991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:46.677804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:46.678467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.678744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.679013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.705906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:46.710798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:46.712280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:46.713115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:46.713746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f1ad-8f1e-4793-b65e-320b8c4122e4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:46.713821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:46.723211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:46.750514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:46.751283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.751562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.751828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.762914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:46.768096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:46.770786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:46.772795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 369/725] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:46.778443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:46.879414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:46.883700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbab9f-f55c-4665-b4ef-962571c63875 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:46.921164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:46.921772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:46.922046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:46.922336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:46.922998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:46.923293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:46.924655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:46.933905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 370/726] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:46.942041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:46.963723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a3f4-2040-47ae-a3f6-13681962c66a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.006638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.040449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.041434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.041912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.042412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.043285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:47.043844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.045459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.067613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 357/727] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:47.073395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.088092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf9b8-23ba-4d33-b349-f4c72e0ae596 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.124287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.124974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.125253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.125520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.137244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.138721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:47.154013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:47.155015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:47.155890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:47.155890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:47.155890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:47.155890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 371/728] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:47.160835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.177450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.264821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb6ce-2cde-4583-94dd-13afb324bdda None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.266746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f736c8-51d1-40f5-acc6-ee935bd2222b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.308668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.309278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.309550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.310022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.311840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:47.312150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.313511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.330418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.331102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.331441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.331713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.339687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 372/729] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:47.349609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.361970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.363454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:47.393820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:47.396085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:47.398190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:47.398190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:47.398190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:47.398612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 358/730] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:47.402296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.457414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.498313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.553556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db1c2-7137-4213-828a-1e1ad2dd888b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.561101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb784bac-3d0c-4ff0-b3c2-bf22a46cc8ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.599035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.599602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.599881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.600152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.600802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:47.601088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.602689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bc59b-0bef-4a73-85da-c035f8858304 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.609341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.610251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.611272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.611742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.616143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 359/731] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:47.618047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e700e1-7baa-4458-b8d1-61d88a93284c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.618352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e700e1-7baa-4458-b8d1-61d88a93284c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.618624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e700e1-7baa-4458-b8d1-61d88a93284c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.624189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 360/732] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:47.624189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e700e1-7baa-4458-b8d1-61d88a93284c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.625847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.627362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-586cc664-0842-46a2-a606-b9586f212e11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:47.640251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:47.641185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:47.642105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 373/733] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:47.646898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.647188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.647536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.668889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:47.670655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:47.734540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.746079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 374/734] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:47.747065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.747766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e700e1-7baa-4458-b8d1-61d88a93284c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.785687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:47.786718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:47.787202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:47.787698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:47.796941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:47.798659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:47.818363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:47.819317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:47.820258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:47.823616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 361/735] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:47.832889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:47.876815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:47.952979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685308f-bbac-4029-b391-ebe77ed81cdd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:47.971200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5846110-8e74-40c0-b11b-a2b48d71a53b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.017370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.017982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.018255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.018547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.019273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:48.019571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.020976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.033597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.034204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.034490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.034753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.035476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:48.035774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.037210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.060570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 362/736] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:48.061769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.064389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 375/737] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:54:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:48.072159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.074913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.176569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a862a34-1930-4895-bf89-abbb74a0be4e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.202989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260d75-bb3d-4731-9862-2868db1eb892 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.218175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.219122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.219536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.219945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.220742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.222511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.228199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.242313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 363/738] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:54:48 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:48.242313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.256363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.257059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.257337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.257604 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.345472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.357045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.358906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aae61d-d545-453c-9f3d-053c77751210 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.399119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38d3-3de5-420f-a160-aacf7e08ba25 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.443095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.444074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.444554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.445449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.472793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 376/739] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:48.474171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40743a-3e48-49ec-b3e0-054363b3389f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.474898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40743a-3e48-49ec-b3e0-054363b3389f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.475193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40743a-3e48-49ec-b3e0-054363b3389f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.477415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 377/740] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:48.478367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad427-3aef-4f0a-bb56-1d91ab10f369 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.478700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad427-3aef-4f0a-bb56-1d91ab10f369 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.478991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad427-3aef-4f0a-bb56-1d91ab10f369 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.480246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 378/741] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:48.480927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad427-3aef-4f0a-bb56-1d91ab10f369 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.500791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.523673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.525139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb997-8082-49da-91fe-5484222a2d25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.589543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad427-3aef-4f0a-bb56-1d91ab10f369 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.598131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.627084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.628179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.628677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.629117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.644704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 364/742] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 14:54:48.644917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.644999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.644999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.645119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.645184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e57195c0-418d-40fc-aef1-bbff1e874628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:48.657535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:48.658512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:48.659418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:48.659418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:48.659418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:48.662561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 379/743] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:48.664000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.664781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.664910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:48.665090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.666106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:48.685531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:48.686808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:48.737160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 365/744] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:48.738504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.758588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:48.767482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 380/745] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 14:54:48.768591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.881838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdd41-7bf5-47c6-842e-b0f9fda738b3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.919839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:48.920908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:48.921491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:48.921955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:48.922834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:48.923830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:48.925403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:48.939380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 381/746] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:48.947737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:48.965905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91ef0-aedb-401f-aa21-16684f5a2d46 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:48.969008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.027216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.027851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.028136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.028404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.038525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.040210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:49.055329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:49.056293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:49.057260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:49.057260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:49.057260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:49.057260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 366/747] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:49.057260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.058249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.096565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d070d-5cdc-486d-8259-fd30a40db2b7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.134702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.135588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.135866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.136137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.143058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.144710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:49.156338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:49.157256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 382/748] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:49.158148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.173239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d082a8-392a-4069-9ddc-5b9f8719c15c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.212240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.213212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.213668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.214117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.224729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:49.230669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:49.231778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:49.232621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 367/749] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:49.233298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.248246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.264990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5fe1-b385-4601-9777-d985754a606c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.285369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.300348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.301019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.301363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.301695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.302692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:49.303057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.304486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.316081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 383/750] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:49.316922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.358175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270bb41-8e42-4591-826c-0fa5e5d0de86 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.393924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.394564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.394842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.395113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.395757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.397115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.413857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 368/751] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:54:49 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:54:49.419853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.422003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7e07-4396-4231-8b29-41b2373f94b9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.469255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.470177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.470630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.471045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.471886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:49.472287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.473944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.492256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 384/752] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:49.493346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.530499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.533229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.580068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1117-6e8a-4f00-8d0d-337363972224 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.612024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390383-d18a-4cb5-8c77-f5eb32908937 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.624322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.624943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.625220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.625489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.626153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:49.626489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.628042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.639081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 369/753] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:49.640051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.654951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.655519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.655795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.656066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.666980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.668466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:49.682511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:49.683411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 385/754] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:49.684731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.779790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccce6a-ae82-4d6a-97ab-ca69dc937c7e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.797695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.804512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ccbe-db68-4342-92e2-4d7b8e547915 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:49.822135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:49.830353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.831387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.831677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.831955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.832954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2caac9bd22464e2cbb6668357c0fe101) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:49.833273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.834931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.849991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 370/755] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/role_assignments?user.id=2caac9bd22464e2cbb6668357c0fe101&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:49.849991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:49.857615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:49.858291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:49.858593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:49.858867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:49.880884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:49.882411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:49.916838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:49.917904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:49.918841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:49.918841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:49.918841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:49.924819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 386/756] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:49.928985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:50.085485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76d16-2784-4c90-92ff-721a5fc28779 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.129381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c515d6-c674-4da7-89b0-b87e30bfa25f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.170020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.170697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.170971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.171240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.171887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:50.172192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.173570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.179014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.180015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.180507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.181023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.181928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:50.182467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.184174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.190296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 387/757] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:50.195335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:50.203039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 371/758] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:50.211952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:50.226693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:50.321673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:50.383143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f356e9-2df9-4534-b230-ec7cebf6ae3f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.399973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016650-41f0-440c-bfb7-4efa142f9f87 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.435134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.436089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.436565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.437031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.437972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=f8f8f0c6b4b049debb3e963dd3b7916b) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:50.438507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.440144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.450321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 372/759] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:50 2022] GET /identity/v3/role_assignments?user.id=f8f8f0c6b4b049debb3e963dd3b7916b&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:50.468640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5d46-4593-4831-824f-6550866e392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.469660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5d46-4593-4831-824f-6550866e392b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.470140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5d46-4593-4831-824f-6550866e392b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.470677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5d46-4593-4831-824f-6550866e392b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.481253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e5d46-4593-4831-824f-6550866e392b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.483367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e5d46-4593-4831-824f-6550866e392b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-400e5d46-4593-4831-824f-6550866e392b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:50.507738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:50.508830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:50.509787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:50.513177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 388/760] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:50.520196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:50.622302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d8cb-64a7-4b13-ab0a-182e4e81b3b8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.622302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d8cb-64a7-4b13-ab0a-182e4e81b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.622302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d8cb-64a7-4b13-ab0a-182e4e81b3b8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.622653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 389/761] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:50.629069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.629339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.629669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.665980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:50.668750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:50.678803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066639-1d48-4435-9765-7b3ae7ed8f9a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.714730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:50.741507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.742127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.744745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.745033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.745856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:50.746173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.749096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.772264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 373/762] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:50.773566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:50.791459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:50.802683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 390/763] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:54:50.909918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0a529-fccd-4527-86b9-e300310ad0c9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:50.955206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:50.955832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:50.956106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:50.956374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:50.967192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:50.968549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:50.991637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:50.992621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:50.993479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:50.993479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:50.993479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:50.994950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 374/764] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:51.003333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.156917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5697-a4be-4539-ae0d-fe25cf882303 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.169846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.206647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:51.208387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:51.209227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:51.209667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:51.210074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:51.211481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:51.211955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:51.213489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:51.233296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 391/765] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:51.240021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.308795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673016d-6d69-4b63-bc02-41ef50b96bf3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.347049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:51.372522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:51.373173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:51.373450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:51.373715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:51.374377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:51.375745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:51.391986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:51.393025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:51.393940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:51.394891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 375/766] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:51.407125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.431530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bbe3-cf48-43fe-b5f9-ee9c01fa2a18 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.494458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:51.495011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:51.495321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:51.495593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:51.508702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:51.510154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:51.525468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:51.526663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:51.527917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 392/767] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:51.533318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.605740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:51.629027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d6d2-bd90-434d-840c-fd1237ec3ff5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.652788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238df6-0a4e-4772-a89c-daf492862562 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.671725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:51.695850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:51.697281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:51.697553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:51.697818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:51.698524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:51.698824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:51.700250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:51.708814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:51.709424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:51.709694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:51.709961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:51.710613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:51.710911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:51.712341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:51.725388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 376/769] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:51.725566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 393/769] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:51.731299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.732591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:51.933093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07126c68-9ab2-499f-9503-2521f2a4c029 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:51.937090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760164-fc54-44af-96e5-9454f1693714 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:52.002850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.003510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.003783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.004052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.007172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.007774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.008106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.008372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.008991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:52.009294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.010820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=456e7e3006f14407ac65e432ace7286d, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.012279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775326f0-ad8d-4fd8-b6be-d66fe72f634a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.014998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376d99-7ebb-4691-8bdc-d47ed9fcd436 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.022537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 377/770] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:52.024370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618e77-4711-490d-8073-7ba6f2b8b12b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.024739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618e77-4711-490d-8073-7ba6f2b8b12b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.031320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618e77-4711-490d-8073-7ba6f2b8b12b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.032704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 378/771] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:52.033617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63618e77-4711-490d-8073-7ba6f2b8b12b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:52.038693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 394/772] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:51 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:52.040485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.040770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.041041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.062761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:52.064096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:52.086504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:52.107680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:52.157797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 395/773] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:52.244595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63618e77-4711-490d-8073-7ba6f2b8b12b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:52.281743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.282448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.282728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.282999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.283704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] RBAC: Adding query filter params (interface=public, service_id=1b3404a7f3e141e0b2bff449efae76ca, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:52.284014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.285531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb18d-57d7-441a-9e02-38eee7856133 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.295733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 379/774] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:54:52 2022] GET /identity/v3/endpoints?service_id=1b3404a7f3e141e0b2bff449efae76ca&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:52.301111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:52.410620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917314b-6d52-4ecd-9f27-1d87699cc467 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:52.459747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.460385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.460621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.460890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.461570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.463052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab02ff3-87de-46f1-b161-82816ba4290e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.468755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 396/775] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:54:52 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:52.537045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704fb6-54c7-4c5d-b967-dbb1c4add406 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.537236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704fb6-54c7-4c5d-b967-dbb1c4add406 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.537626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704fb6-54c7-4c5d-b967-dbb1c4add406 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.539605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 380/776] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:52.545043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.545520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.545942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.555339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42704fb6-54c7-4c5d-b967-dbb1c4add406 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:52.571162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:52.572763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:52.615375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:52.700561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 397/777] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:52.713321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:52.732088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42704fb6-54c7-4c5d-b967-dbb1c4add406 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:52.767631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.768578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.769011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.769431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.770177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.771779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8cceb1af-41ed-4766-90e7-4ef144f98078 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:52.782681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:52.783923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:52.784941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:52.787569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 381/778] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:52 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:52.793391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:52.899340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea17f2-c99f-4b58-a150-30c8fa57333a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.899970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea17f2-c99f-4b58-a150-30c8fa57333a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.900434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea17f2-c99f-4b58-a150-30c8fa57333a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.900937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43e8d-da94-422a-b616-5a4e81ca6ab8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:52.902470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 382/779] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:54:52.908916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.909458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.909923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.928502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:52.930028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:52.950548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:52.951169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:52.951440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:52.951705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:52.952394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] RBAC: Adding query filter params (name=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:52.952692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:52.954231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:52.965561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 398/780] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:52.970991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.004172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 383/781] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:54:53.034254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.101215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.129280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753f915-6680-4204-ac57-aa899a9fdf32 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.166335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.166946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.167222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.167491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.168264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] RBAC: Adding query filter params (type=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:53.168514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.169879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.175454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 399/782] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:53.181616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.192892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.215166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc423781-eefd-4b13-9600-a1ba481b03ff None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.252271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.253374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.253947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.254454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.265973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:53.271329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:53.272235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:53.273051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:53.275705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 384/783] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:53.287238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.290716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.304143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d2480-059b-43d2-abd5-a5527ccd474a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.341892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.342547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.342829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.343102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.343803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] RBAC: Adding query filter params (interface=public, service_id=04388832059748e79e950bc3d6e3f3b6, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:53.344109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.345476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.354031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 400/784] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/endpoints?service_id=04388832059748e79e950bc3d6e3f3b6&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:53.354906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.422532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d186-7e7a-492a-8776-ef98ff71523c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.461823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.462854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.463327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.463804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.464644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:53.465154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.466744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.475561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 385/785] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:53.476650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.480258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.494179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff6a04-0a67-4369-bb62-e319fe4b08f0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.537979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.538674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.539089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.539439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.556622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:53.562345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:53.563253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:53.564078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:53.566762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 401/786] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:53.567793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.585326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.597574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59f2b-8dbc-48cf-8dd6-f43ac27a0f33 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.643272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.643894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.644430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.644715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.645322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.647521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.662356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 386/787] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:53.663562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.703638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80141e84-3781-43d6-90ff-0f1c7a14b3e7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.780925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.781991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.782517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.782988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.801203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.804443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.826660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:53.832748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:53.833740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:53.835469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:53.835469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:53.835469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:53.835469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 402/788] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:53.841261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.873432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684cfb4-3c76-477c-99f3-0d3f0f8e1af4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:53.920970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:53.921508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:53.921822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:53.922097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:53.922784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:53.923083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:53.924591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:53.934123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:53.940137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:53.942228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:53.987293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bcf62-7185-4988-b14b-5f39b4b1e62b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.031509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.032120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.032750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.033043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.033689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:54.033993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.035562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.055169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 403/790] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:54.060722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.104233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d761-a1eb-4006-86cd-91df90d1ea4f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.166638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccd42-455b-4503-8413-0b5c134cc04f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.202367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:54.208702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:54.208956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.209685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.209861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.210121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.219570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.221280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:54.235337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:54.236312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:54.237242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 404/791] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:54.242069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.259588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.260244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.260525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.260800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.291335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.292799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:54.327416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:54.328413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:54.329288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:54.329288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:54.329288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:54.329288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 388/792] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:54.334135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.353542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2da-5850-43d6-9fc8-3cd91734e305 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.393480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.394089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.394400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.394669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.395391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:54.395688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.397554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.546542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 405/793] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:54.555334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.564738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc7d03-8e41-4707-9f12-d35b6763e03c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.623993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.624609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.624881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.625146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.625783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:54.626081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.627466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.646989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:54.650488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 389/794] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:54.654734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.733912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:54.752987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50b1-b02c-4128-ab69-d3a0b8bb7ebf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.806467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.807309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.807596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.808280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.814581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970250bb-1f0a-44e9-84f3-72746a2c58d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:54.821821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.823339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-95693bf4-60e9-4d0d-9b92-5b8df1ac686c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:54.844486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:54.845528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:54.847071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:54.847071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:54.847071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:54.847071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 406/795] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:54.847831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb90b2-6101-4b94-af2b-b5cbcf113a27 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.848105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb90b2-6101-4b94-af2b-b5cbcf113a27 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.848379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb90b2-6101-4b94-af2b-b5cbcf113a27 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.854441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 407/796] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:54.854441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb90b2-6101-4b94-af2b-b5cbcf113a27 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:54.866760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:54.868091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.868611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.869084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.877153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:54.879008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7dad9510-0c34-4236-bd8a-aadd683829ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:54.895380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:54.896449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:54:54.898098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:54.907619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 390/797] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:54.909198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:54.909690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:54.910153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:54.929559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:54.931081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:54.971537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:54.985997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb90b2-6101-4b94-af2b-b5cbcf113a27 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.022383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 391/798] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:55.023292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.033206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.034203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.034757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.035225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.036601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:55.037138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.038800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.053087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 408/799] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:55.058941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.095005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.203109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d992-9456-4c24-9b9d-10ff333f6150 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.220494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bd1eb-4b14-4f3a-aa62-09147c195808 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.243376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.244317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.244810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.245279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.246295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:55.246835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.249105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.268914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 392/800] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:55.274231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.293498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.294757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.296986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.297467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.312481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.315987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-30c03575-9df2-437a-a008-2b7a63c9c919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:55.337991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:55.338951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:55.339838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:55.342873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 409/801] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:55.344217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10849-6672-4b5e-927c-a62a347771ec None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.344644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10849-6672-4b5e-927c-a62a347771ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.345063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10849-6672-4b5e-927c-a62a347771ec None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.346689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 410/802] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:55.348014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10849-6672-4b5e-927c-a62a347771ec None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.369146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.410415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.425504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b33-fbc0-4cda-b535-cd67b6e43ef9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.456330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10849-6672-4b5e-927c-a62a347771ec None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.460978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.461843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.462325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.462775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.473047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.474582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:55.490763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:55.491720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:55.493191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:55.493191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:55.493191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:55.493191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 393/803] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:55.493191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.499109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.499749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.500020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.500280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.510750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d4b99709-906e-4e81-9df8-85676325f81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:55.515842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:55.516733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:55.518193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 411/804] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:55.518939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.518939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.518939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.537623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:55.539292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:55.602246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c2c5-f0a1-46b7-80d6-c1a8ba1498d4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.609874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 412/805] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:55.610793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.624212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.652736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.653348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.653627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.653900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.654628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:55.654937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.656354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.668286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.674422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 394/806] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:55.675319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.752351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba710a-aaa5-464a-aaf8-f187c9c5f018 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.787960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.788173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8b47-837e-4a65-bc47-a47cbe9d3dee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.788639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.788924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.789265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.789902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:55.790207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.791636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.803877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 413/807] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:55.805336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.827243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.828027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.828454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.828821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.829643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:55.830039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.831591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.845107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 395/808] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:55.846073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:55.873837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.910954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd12f6-b231-40a3-87f3-50dc7dc647c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.911700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:55.951395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:55.952062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:55.952168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf3033-67e2-4c0b-ab4c-dbae702d1246 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:55.952342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:55.952615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/2caac9bd22464e2cbb6668357c0fe101/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:55.967286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=2caac9bd22464e2cbb6668357c0fe101, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:55.968753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:55.988978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 414/809] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:55 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/2caac9bd22464e2cbb6668357c0fe101/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:55.989599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.001089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.002297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.003365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.003910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.015749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.018617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:56.037621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:56.038623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:56.040053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:56.048832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 396/810] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:56.048832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.125795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdad6c-f521-40ce-994b-836c3d0a32ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.151188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:56.176388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.177281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.177876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.178146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.180865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a617-20ac-4a67-b76b-721ab110e83b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.189057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.190805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:56.205392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:56.206507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:56.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:56.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:56.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:56.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 415/811] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:56.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.207881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:56.222145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.222819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.223104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.223376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.223962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.225330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-021138c5-f337-490e-86b9-d893030b9f78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:56.235463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:56.236608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:56.237562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 397/812] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:56.238575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797f7e-4b12-4dc0-84c6-1bbfd7efe423 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.238575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797f7e-4b12-4dc0-84c6-1bbfd7efe423 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.238575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797f7e-4b12-4dc0-84c6-1bbfd7efe423 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.243912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 398/813] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:56.243912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21797f7e-4b12-4dc0-84c6-1bbfd7efe423 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.321588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c03af-0395-4642-9dfb-f1a23e7ebc57 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.358869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.359494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.359769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.360035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.360741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:56.361042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.362555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.381337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 416/814] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:56.381337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.410792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:56.481421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21797f7e-4b12-4dc0-84c6-1bbfd7efe423 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.488267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f01a-35c9-46f5-845f-7449c4e776e6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.519634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.520243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.520518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.520787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.521444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:56.521776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.522924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.523115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.524028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.524298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.524560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.525172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:56.525466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.526823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468b897-fd90-4a20-8c45-8c43a05f38d0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.535859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 417/815] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:56.535859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.535859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.535859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.545911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 399/816] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:56.545911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.551121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:56.552554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:56.597138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:56.630293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 418/817] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:56.630293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.654025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:56.673859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b07554-e77d-4f23-8916-0e9029c0ee4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.713383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.714170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.714542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.714901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/f8f8f0c6b4b049debb3e963dd3b7916b/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.716937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=f8f8f0c6b4b049debb3e963dd3b7916b, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.718521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.742221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 400/818] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:54:56 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/f8f8f0c6b4b049debb3e963dd3b7916b/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:54:56.743824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.750437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76704d2c-bd63-4930-bc4e-f0a699bde188 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.826402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:56.827039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:56.827313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:56.827579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:56.828223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:56.828523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:56.832506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:56.845466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 419/819] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:56.850285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:56.953583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f451-cf95-42c1-88a5-1f078234667a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:56.961899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.000084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.006228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.008589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.009332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.010306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.017876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bf070-af06-438e-bdf3-46110bdc75e5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.022603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.024671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:57.040890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:57.042002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 401/820] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:54:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:57.046244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.063585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.064459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.064938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.065418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.066386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.067970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.096569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 420/821] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:54:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:54:57.097864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.162368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0cf21-c465-4ad3-aa3a-74c6b989ccf2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.218411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.218411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.218411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.218411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.218826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.218826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:57.234669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:57.235720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:57.236555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 402/822] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:57.241691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.290826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885d22-d4d8-4b90-a481-952ca15f9a64 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.318941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.403614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92432d2-ae1a-452d-b001-666c19be310e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.411476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.412104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.412380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.412649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.413382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:57.413684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.415695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.431688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.436185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 421/823] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:57.444304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.452047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.452659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.452939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.453209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.453842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:57.454145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.455569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.462383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 403/824] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:57.466400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.562859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e07a-1317-46da-8080-af21c3cd8a32 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.600040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.600654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.601188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.602002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.664848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.685580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.687085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.690640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.704260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1631-c467-4628-9e27-25cf2749512c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.791022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.791813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.792188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.792577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.793307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:57.793702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.795177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.797900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 422/825] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:54:57.800848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 404/826] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:57.803765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.806969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:57.933110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794bc27-e315-4fdb-b4cf-4abf76bb13dd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:57.962644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:57.969831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:57.970463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:57.970738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:57.971001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:57.971687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:57.973021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:57.975669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9bda0-e4e5-460a-b21e-63176ff86593 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.015986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 405/827] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:54:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:54:58.034646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.035291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.035567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.035834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.047214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:58.048918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f94a04da-0d76-44a4-83e7-463f5e00d565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:58.066063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:58.067090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:58.067954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:58.067954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:58.067954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:58.067954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 423/828] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:58.075495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.100489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:58.212316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078e61-30e5-4f91-bb7a-60dba66cb6d1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.250236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.250874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.251151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.251418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.252054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:58.252355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:58.253716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f85fd-a4e5-4d0c-938d-4900085a1921 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:58.264793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7aa5-12ee-4a0e-8c77-09faa0f1f683 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.265087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7aa5-12ee-4a0e-8c77-09faa0f1f683 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.265336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7aa5-12ee-4a0e-8c77-09faa0f1f683 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.266970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 406/830] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:58.267105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 424/830] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:58.272403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.272685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.272964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.275691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7aa5-12ee-4a0e-8c77-09faa0f1f683 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.293880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:58.295425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:58.383169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:58.383675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 407/831] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:54:58.403735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7aa5-12ee-4a0e-8c77-09faa0f1f683 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.439295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.439927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.440210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.440535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.448112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:58.449627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:54:58.461999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:58.462953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:58.463864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 425/832] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:58.468906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.572833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7ea78-58a1-4ed3-8966-bb85e71ccece None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.607458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.608129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.608403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.608676 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.609360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:58.609662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:58.611099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:58.623947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 408/833] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:54:58.631402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.642905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:58.705352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.744899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af945cc-2433-4cdb-a094-e8c20552802f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.778662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:58.782231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.782231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.782451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.782641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.783357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:58.783661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:58.785099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:58.798294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 426/834] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:58.824496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d43cc-4862-405d-aeb1-c7aa0da143f8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:58.863432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:58.864089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:58.864363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:58.864632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:58.881873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:58.887416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:58.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:58.889184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 409/835] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:58.896519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:58.982161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.014659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee214089-4df1-4586-9672-6f21cefb49be None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.049557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.050260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.050565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.050833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.051485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:59.051784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.053402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7e798-4e96-4744-a8ef-c9ce6987b907 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.062326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 427/836] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:59.067890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.178381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf1ef-1ff8-4dc6-baea-2c5dde708b5e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.199178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.213521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.214157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.214476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.214974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.227139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.228582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:54:59.243453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:59.244419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:54:59.245278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:54:59.245278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:54:59.245278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:54:59.245278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 410/837] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:59.249292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60cad-4e64-4f32-936f-686b0ee71197 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.249577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60cad-4e64-4f32-936f-686b0ee71197 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.249843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60cad-4e64-4f32-936f-686b0ee71197 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.254684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 428/838] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:54:59.256714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.256831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55757-b346-4a59-8729-fb387002d56b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.256831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55757-b346-4a59-8729-fb387002d56b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.256831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55757-b346-4a59-8729-fb387002d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.276059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-98d55757-b346-4a59-8729-fb387002d56b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:54:59.276992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-98d55757-b346-4a59-8729-fb387002d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:54:59.353176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 429/839] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:54:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:54:59.375933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f73ba-c537-4a40-a06c-2bbb564a71a7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.411046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.411711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.411993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.412262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.412901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:59.413202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.414650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.427289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 411/840] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:59.432943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d55757-b346-4a59-8729-fb387002d56b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.497160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.536911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d55757-b346-4a59-8729-fb387002d56b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.572924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.573653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.573931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.574203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.581557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.583020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:54:59.599290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:59.600244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:59.601866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 430/841] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:54:59.606280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.637819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.647347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.719086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0442b4-abf9-433c-bfcc-f2c6fdb83f38 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.759363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c307-bca5-46ac-9149-cfdd7a369735 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.761034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.761890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.762431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.762925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.763848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:59.764366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.765979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.783329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.784828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 412/842] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:59.793472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.799719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.800522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.800966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.801383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.813730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:54:59.820843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:54:59.821996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:54:59.822864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:54:59.830357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 431/843] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:54:59.831716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:54:59.893649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:54:59.905054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f6742-f586-4d42-ad46-316accda013a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.938830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.939425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.939699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.939963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.941012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2072a-efc0-4321-b85c-376f25537c79 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:54:59.976228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:54:59.977332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.977606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.977871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:54:59.978569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:54:59.978866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:54:59.980441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12310a7e-462f-45e7-b077-f03bc240edca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:54:59.992759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 432/844] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:54:59.998652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd86d5-df25-4c16-895f-6d9c1c072267 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:54:59.998927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd86d5-df25-4c16-895f-6d9c1c072267 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:54:59.999195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd86d5-df25-4c16-895f-6d9c1c072267 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.002307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 433/845] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:54:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:00.002307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd86d5-df25-4c16-895f-6d9c1c072267 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.020899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.022359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62932c1-7bff-447a-bb31-1d3d28102737 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.051647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.109172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd86d5-df25-4c16-895f-6d9c1c072267 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.114966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.130955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 413/846] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:54:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:00.130955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.130955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.130955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.147024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:00.148745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:00.150699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.151326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.151600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.151865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.163172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.164654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:00.178907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:00.180428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:00.181300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:00.181300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:00.181300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:00.181300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 434/847] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:00.181300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.231866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 414/848] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:00.232703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.315105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.319926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93533d-2b8e-49cc-ad47-cb2fa2346f0d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.338543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc986-a038-4b6c-92f2-853be50fc27c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.359168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.360069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.360547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.361035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.361838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.374931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.377014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.377845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.378497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.378772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.379046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.379813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:00.380125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.381594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:00.394027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:00.395270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:00.396160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:00.396160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:00.396160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:00.402050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 415/849] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:00.402050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.402554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 435/850] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:00.403946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.508262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb2ad-c87a-4157-9601-823beb927e3d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.509857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a24a-a729-4356-8ab8-dd41433b5e03 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.542744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.543350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.543633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.543905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.544539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:00.544675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.544871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.545674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.546089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.546209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.546658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.555746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.557182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.559356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 436/851] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:00.560421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:00.569145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:00.570073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 14:55:00.571373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:00.574830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 416/852] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:00.575516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.576237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.620328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.668202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2de8-fa21-4389-a12e-42ed77021549 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.681827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81fb0-f309-401e-8dd1-4ec0ca3fca68 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.706139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.706817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.707090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.707356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.707927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.709280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.717118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.717747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.718023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:00.718183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:00.719319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:00.720146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:00.720882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.720955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 437/853] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:00.720955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.731389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.732832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:00.744160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:00.745060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:00.745951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 417/854] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:00.746467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.804214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.831586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f28-f4da-4e25-937d-847f842a9ed2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.848891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:00.852413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92161-3b51-4e98-aa67-4d98cfb6fe19 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:00.868477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.869164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.869442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.869710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.870500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:00.870786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.872220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.889264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 438/855] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:00.889680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:00.890057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:00.890646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:00.890920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:00.891188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:00.891804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:00.892103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:00.893484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:00.899529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 418/856] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:00.900309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.004042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c4f2-6792-4b1a-a25d-14057edbe9fb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.024761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99068-f7eb-4934-a68c-19c206bc9923 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.036373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.042280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.042904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.043183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.043453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.044144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:01.044449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.045874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.058066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 439/857] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:01.058897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.068810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.069767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.070299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.070746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.104585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.143830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.145266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d224ee-9d3d-4148-b8ac-a89aabb0ef42 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.159917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d526-6f78-4bd1-9775-1316327c68da None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.193982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.194608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.194885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.195682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.196295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:01.196588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.197929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.202284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 440/858] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:01.203059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.262301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 419/859] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:01.263868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dc53-9696-4f9c-9dad-04d1a8992232 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.264152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dc53-9696-4f9c-9dad-04d1a8992232 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.264423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dc53-9696-4f9c-9dad-04d1a8992232 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.265966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 420/860] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:01.268202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209dc53-9696-4f9c-9dad-04d1a8992232 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.269472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.325267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a33fb1-90d6-48cf-b471-c9f4045a87e2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.340391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.365912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.366473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.366747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.367962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.368321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2caac9bd22464e2cbb6668357c0fe101) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:01.368625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.370094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742b19-3ae6-4e98-98ba-beb60d5d1db4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.376777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 441/861] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/role_assignments?user.id=2caac9bd22464e2cbb6668357c0fe101&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:01.387829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.388112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.388384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.397677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209dc53-9696-4f9c-9dad-04d1a8992232 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.408237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:01.409469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:01.439432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.440336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.440614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.440884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.452457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.453915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:01.472239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:01.473256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:01.474613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:01.474613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:01.474613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:01.474613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 421/862] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:01.483496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.505388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 442/863] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:01.602978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9cd29-d7d1-4fba-a272-48ec8c402cc1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.620227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.638838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.639449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.639726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.639994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.640635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:01.640938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.642309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.655256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 422/864] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:01.661342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.716540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:01.778473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d9bae-274d-4837-a9a5-dd9494acb402 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.779147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.826673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.828494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.828956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.829420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.839455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.841625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:01.857741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:01.858690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:01.859581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:01.862627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 443/865] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:01.868331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.894397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6de6f-aca7-4ca9-aae8-6f498eb36d74 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:01.932695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:01.933466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:01.933838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:01.934352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:01.935029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:01.936469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:01.946777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:01.947815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:01.948716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:01.953476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 423/866] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:01.954583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:01.989311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d857-4675-43ee-b1d2-bd0fd9b29a14 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:02.001983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:02.019284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:02.032272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:02.033189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:02.033668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:02.034118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:02.035007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:02.035535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:02.037265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:02.051765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 444/867] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:02.058318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:02.092832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5eb1b-2131-4771-b600-d041f184e682 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:02.140632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:02.141516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:02.142425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:02.143007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:02.143897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:02.145108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:02.147492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:02.154753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 424/868] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:02.164791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:02.169398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f310e-39c1-4064-ae62-7f8632249154 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:02.208252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:02.208988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:02.209323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:02.209662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:02.210514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=f8f8f0c6b4b049debb3e963dd3b7916b) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:02.211531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:02.213021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83e6f-dc76-4a7d-afba-455571913c5f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:02.222747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 445/869] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:02 2022] GET /identity/v3/role_assignments?user.id=f8f8f0c6b4b049debb3e963dd3b7916b&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:02.285700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f9cf-e1de-4bc2-b1e0-e0d7250d2326 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:02.288846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:02.328903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:02.329788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:02.330249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:02.330689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:02.331518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:02.331960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:02.333539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481af5-8efc-447d-b447-cf3f86ab8808 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:02.339432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 425/870] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:03.441266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a8317-0773-4aa8-8f0e-f1cc047443d2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:03.441786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a8317-0773-4aa8-8f0e-f1cc047443d2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:03.441786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a8317-0773-4aa8-8f0e-f1cc047443d2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:03.443433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 446/871] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:03.449360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76fd8-6be7-42a7-b278-976abe562872 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:03.449746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76fd8-6be7-42a7-b278-976abe562872 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:03.449906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76fd8-6be7-42a7-b278-976abe562872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:03.468409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6fc76fd8-6be7-42a7-b278-976abe562872 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:03.469603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6fc76fd8-6be7-42a7-b278-976abe562872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:03.540416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 426/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:03.754813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f3d8-636c-4033-84f9-da082e66c695 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:03.755466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f3d8-636c-4033-84f9-da082e66c695 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:03.755949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f3d8-636c-4033-84f9-da082e66c695 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:03.758346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 447/873] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:03.763666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:03.764168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:03.764643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:03.783485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:03.784942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:03.815360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0f3d8-636c-4033-84f9-da082e66c695 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:03.852250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:03.866309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 427/874] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:03.932283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0f3d8-636c-4033-84f9-da082e66c695 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:03.967816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:03.968430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:03.968714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:03.969034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:03.969697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:03.971100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:03.996857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 448/875] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:03 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:04.143931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.174768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:04.253021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978de5e-0fea-4656-8444-64a71b28354e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:04.295090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:04.295728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.296007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.296277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.307272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d4d46c2b-f762-49e7-a8fe-930a2e66cff9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:04.312361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:04.313321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:04.314614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 428/876] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:04.320741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.425655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:04.436178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f5aee-84cb-4038-a0ba-e12f0fe5bc5c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:04.441922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc6f6-7162-4a97-b848-29f5c441dfcb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.442259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc6f6-7162-4a97-b848-29f5c441dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.443133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc6f6-7162-4a97-b848-29f5c441dfcb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.445463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 429/877] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:04.450844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788322-ff32-45bf-a04a-77ef6b20d3a1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.451789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788322-ff32-45bf-a04a-77ef6b20d3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.452286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788322-ff32-45bf-a04a-77ef6b20d3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.473612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5b788322-ff32-45bf-a04a-77ef6b20d3a1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:04.476028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5b788322-ff32-45bf-a04a-77ef6b20d3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:04.484814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:04.485485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.485728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.486003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.486756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:04.487066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:04.489424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:04.506319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 449/878] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:04.509921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.582426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 430/879] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:04.597123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd216b-c083-4bfd-9393-c58c661908e2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.597653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd216b-c083-4bfd-9393-c58c661908e2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.598093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd216b-c083-4bfd-9393-c58c661908e2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.603552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 431/880] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:04.604831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.605263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.605682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.619885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952b8e-5816-4b62-b0b8-1594079bd202 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:04.624591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:04.625936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:04.636245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:04.656163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:04.657037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.657464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.657989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.669059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:04.670827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:04.686029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:04.687067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:04.688023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:04.688023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:04.688023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:04.694699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 450/881] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:04.695882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.711148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:04.714742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 432/882] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:04.801203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec362-c452-43e8-8daf-7715b430c5b9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:04.835473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:04.836876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:04.837300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:04.837724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:04.838531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:04.838983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:04.840474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:04.852524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 451/883] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:04.858350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.893240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:04.983506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:04.983647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35b61-7155-4a2e-97d4-3de457cef8cd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.016538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729ed21-3058-47d0-b999-1ffd485a62d4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.021735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.022395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.022674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.022943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.030813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.032240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:05.044116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:05.045065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 433/884] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:05.046024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.053890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.055408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.056362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.056789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.057217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.058109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.059661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:05.068570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:05.074481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:05.075349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 452/885] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:05.076149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.167429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff78ba-682d-433c-9a0e-1b1264929b22 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.175684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc873-f4aa-4168-a128-d13d3803ea65 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.204560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.205167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.205443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.205716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.206385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.206534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.207749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.213018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.213928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.214220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.214524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.215258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:05.215571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.217218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.226666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 434/886] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:05 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:05.226666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.251918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 453/887] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:05.257092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.307355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.363050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8bba-09fe-4d3a-8289-b5097fe6d9e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.391320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69cbe-bd71-43b4-a68a-651f82367527 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.402864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.403476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.403752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.404017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.404694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:05.405000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.406383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.414351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 435/888] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:05.418549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.442535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.443556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.443896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.444271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.515129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.529001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.531197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.547492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5babef-2ac5-4a48-845a-178e33c4f22f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.574375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.591775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.592672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.593123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.593637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.594572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:05.595062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.596599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.602083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 436/889] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:05.653167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 454/890] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:05.659073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.778795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac411af-29ab-441d-9a3c-a633cab86dfd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:05.825413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:05.826046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:05.826352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:05.826621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:05.837584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:05.839044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:05.853700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:05.854684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:05.855570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:05.855570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:05.855570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:05.855570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 437/891] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:05.860596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:05.954798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:05.965334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce4e-48ce-4ee0-91ae-71205d665500 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:06.012118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:06.012724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.012998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.013266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.013903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:06.014200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:06.015572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:06.027514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 455/892] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:06.032959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:06.079225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:06.142499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552c2f-4e92-459a-b119-048d1769a7ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:06.184296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:06.184944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.185271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.185548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.193310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:06.194797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7f8b4343-a3ff-4c1b-b7bf-f0153f9191e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:06.206531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:06.207473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:06.208347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 438/893] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:06.214521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:06.279663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd746-b2ff-4ae1-85e0-a3d855ca71cc None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.280008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd746-b2ff-4ae1-85e0-a3d855ca71cc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.280206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd746-b2ff-4ae1-85e0-a3d855ca71cc None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.281832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 439/894] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:06.287697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.287924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.288203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.308814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:06.310117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:06.319164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb1ded-fbd5-4e31-8841-4a0a092fe293 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:06.355179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:06.355787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.356063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.356333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.357014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:06.357314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:06.358766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:06.377980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 456/895] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:06.379832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:06.386340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 440/896] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:06.395105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:06.482129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430f91-662c-4fa3-bef4-fb8e448111cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:06.518130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:06.518792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.519020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.519289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.520001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] RBAC: Adding query filter params (role.id=0813e6b95a20462eaa205dee6f0bb1a9, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2caac9bd22464e2cbb6668357c0fe101) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:06.520360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:06.521787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:06.527596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 457/897] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:06 2022] GET /identity/v3/role_assignments?user.id=2caac9bd22464e2cbb6668357c0fe101&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=0813e6b95a20462eaa205dee6f0bb1a9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:06.670735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:06.714252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:06.783824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061ca46-445b-41ff-bc09-0fb228fc69f1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:06.861347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:06.862324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:06.862324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:06.863750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:06.863750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:06.870301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:06.877070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:06.878052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:06.878911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 441/898] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:06.881590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:07.005936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:07.029162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb4be-00bf-47cf-9cda-82cc5cb2739c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:07.068346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:07.068782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.069050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.069323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.069996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:07.070326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:07.071705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:07.078214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 458/899] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:07.085170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:07.228586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:07.237501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4674e8-1df6-46b5-9eba-23394c8b8fdf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:07.275280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:07.275926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.276207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.276714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.277112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:07.277417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:07.278955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:07.287885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 442/900] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:07.292082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:07.407447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b32db-bdb1-4390-99bb-f5eb4f9ddcad None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:07.455146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:07.455774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.456053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.456325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.457037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] RBAC: Adding query filter params (interface=public, service_id=ba02bcdbda4c470f8147b1ecf6dda820, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:07.457345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:07.458813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a778-84f6-44cf-95c0-6e4aeeb6e150 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:07.469661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 459/901] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:55:07 2022] GET /identity/v3/endpoints?service_id=ba02bcdbda4c470f8147b1ecf6dda820&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:07.473083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:07.605786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f4bc-8cb3-42ad-9d4d-c9e0b2ee9767 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:07.649865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:07.650533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.654288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.654288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.654288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:07.654288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9a241-9cc1-466e-9b61-70586b92cfa1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:07.662472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 443/902] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:07 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:55:07.678547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a572-a4c4-452d-a034-fe71fa922dc9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.680084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a572-a4c4-452d-a034-fe71fa922dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.680574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a572-a4c4-452d-a034-fe71fa922dc9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.686741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 460/903] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:07.688168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5ce7-4fe9-4767-ad94-2ba0b0afbe58 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:07.688597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5ce7-4fe9-4767-ad94-2ba0b0afbe58 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:07.688762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5ce7-4fe9-4767-ad94-2ba0b0afbe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:07.709459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f7ea5ce7-4fe9-4767-ad94-2ba0b0afbe58 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:07.711252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7ea5ce7-4fe9-4767-ad94-2ba0b0afbe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:07.735123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:07.800047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 444/904] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:08.071118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8a572-a4c4-452d-a034-fe71fa922dc9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.074666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:08.091117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018417-f12c-4fe0-81d4-796881f590a8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.091420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018417-f12c-4fe0-81d4-796881f590a8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.091683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018417-f12c-4fe0-81d4-796881f590a8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.093275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 445/905] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:08.098184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.098508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.098788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.118637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:08.119833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:08.201856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8a572-a4c4-452d-a034-fe71fa922dc9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.204143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 446/906] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:08.240197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.240759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.241036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.241306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.241923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.243321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:08.252487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:08.253396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:08.254260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 461/907] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 14:55:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:08.262043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.342539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:08.361253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48d4f9-1252-4a2d-a1fe-262dd0e19174 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.399607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.400219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.400554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.400830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.401459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:08.401761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.403155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.408354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 447/908] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:08.415406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.485168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.491378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:08.530368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53768-1367-42f4-949e-1ae72f924e90 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.567906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.568609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.568810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.569059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.569687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:08.570054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.571575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.577688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 462/909] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:08.582891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.620017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c124b-a00e-4fd0-a753-4bcffddae6bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.667766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.669144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.669533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.669913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.670986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.672557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.697521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 448/910] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:08 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:08.709950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f798a5-5515-4d79-81a6-a89f5c6430e0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.749154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:08.766640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.767718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.768222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.768696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.769627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] RBAC: Adding query filter params (interface=public, service_id=b872768acfdd427f93bd0016f9c509da, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:08.770224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.771890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e327d-ebd1-49d7-bbf1-1f1a375ff76f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.778741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 463/911] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:55:08 2022] GET /identity/v3/endpoints?service_id=b872768acfdd427f93bd0016f9c509da&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:08.787461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:08.798042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:08.853970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecaa0-d681-4d63-906e-147d3422deb8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.854622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecaa0-d681-4d63-906e-147d3422deb8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.855349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecaa0-d681-4d63-906e-147d3422deb8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.858230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 464/912] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:08.864006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.864590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.865094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.892550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:08.894391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:08.911097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb37f9-f08d-4542-a02e-0d09752d42bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:08.955815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:08.956806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:08.957460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:08.957939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:08.959110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:08.961901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:08.975602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 449/913] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:08 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:55:08.994316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 465/914] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:09.262914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:09.336128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:09.370824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a24f3-2bf4-4da9-9c7d-4f5c0b0ea38f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:09.406130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:09.407143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:09.407617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:09.408080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:09.418953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:09.424594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:09.425527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:09.426382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:09.429298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 450/915] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:09.434964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:09.540027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68601c-dcc1-4725-9811-20e310b919fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:09.565257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:09.580207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:09.580818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:09.581092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:09.581357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:09.582014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:09.582446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:09.583811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:09.592171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 466/916] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:09.597560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:09.709125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa76e-3c5b-4f5b-9290-b29f4641b2f5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:09.739026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:09.746194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:09.747121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:09.747602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:09.748094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:09.759663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:09.761332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:09.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:09.776588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:09.777457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:09.777457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:09.777457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:09.779524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 451/917] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:09.790401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:09.894488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4e616-91ac-43d7-ab5d-217d5f96ed62 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:09.933792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:09.934503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:09.934782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:09.935051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:09.935691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:09.935992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:09.937354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841414d5-14ec-45d2-b918-097b99086bb1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:09.949697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 467/918] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:09.955098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.008965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d2a3-9753-443c-8684-5c8cc1004f3b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.009298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d2a3-9753-443c-8684-5c8cc1004f3b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.009513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d2a3-9753-443c-8684-5c8cc1004f3b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.011142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 468/919] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:10.016755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.017031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.017299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.039185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:10.041261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:10.081538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b550f0-9aa8-4753-99b9-f2009d041054 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.093375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.135295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.136243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.136530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.136800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.142072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 469/920] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:10.153292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.155034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:10.167750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:10.168687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:10.169636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:10.172256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 452/921] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:55:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:10.178457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.283554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c82c82-7665-49ee-a6ef-875a435ac003 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.318178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.318854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.319130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.319399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.320659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:10.320962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.322469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.341793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 470/922] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:10.348712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.396889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.438884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.459913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e02d9-9195-43e7-9519-904d32e68dbb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.471036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.497671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.498322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.498606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.498877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.509748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.511277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:10.526658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:10.527626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:10.528505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:10.528505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:10.528505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:10.528505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 453/923] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:10.533570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.562096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882aaa5-6cc4-4927-9e19-80703ca315c9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.611235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.611796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.612072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.612339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.613456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.615314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:10.627277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:10.629351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:10.630393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 471/924] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:10.634215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.635835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.651996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35094758-0bc9-4d32-bc63-761e657fae75 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.690346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.691092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.691477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.691814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.692564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:10.692934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.694454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.712862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 454/925] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:10.713897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.782287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.790624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647fcc8-b58f-4ef1-b5ee-f2fc543de9a6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.833034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b4f74-90b1-47e9-81ee-d70222f4761c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:10.834336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.835090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.835953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.836294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.836996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:10.838021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.838841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.848951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 472/926] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:10.851290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.884322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:10.885043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:10.885223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:10.885627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:10.894521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:10.896714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:10.909745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:10.910691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:10.911569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:10.916021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 455/927] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:10.917555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:10.938810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:10.989676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb735ca-6e53-4130-8c9a-e4608138e9c4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.026847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.027815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.028090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.028359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.028986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:11.029381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.030673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6271179-20cf-47a2-ad0c-dd05b56a6ceb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.035518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 473/928] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:11.036497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01d23-29cb-4619-a256-c7c3eeacb4df None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.036775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01d23-29cb-4619-a256-c7c3eeacb4df None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.037044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01d23-29cb-4619-a256-c7c3eeacb4df None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.042705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 474/929] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:11.042836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b13d-b3fd-4346-a4d2-48b59198218f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.043766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.044045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.044314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.063274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:11.064459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:11.078907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.079512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.079787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.080093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.080836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:11.081143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.081899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.082642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.096172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 456/930] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:11.101885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.139106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 475/931] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:11.143128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.189118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.219032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14e09-8d7c-4a1b-b178-2cc348b82367 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.263360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.264876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.265305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.265769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.266711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.268341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c074546-be4e-4d08-8b7e-b5f5168e529f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.270044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487045-bfb3-4203-99ff-93224f7cfa92 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.295251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 457/932] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:11.295251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2b71-c36c-4409-9cdb-ed77064e9d21 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.295251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2b71-c36c-4409-9cdb-ed77064e9d21 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.295251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2b71-c36c-4409-9cdb-ed77064e9d21 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.298843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 458/933] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:11.300217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.300537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.300761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.322486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.323237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:11.323754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.324296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.324518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:11.325009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/2caac9bd22464e2cbb6668357c0fe101/roles/0813e6b95a20462eaa205dee6f0bb1a9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.327707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=2caac9bd22464e2cbb6668357c0fe101, role_id=0813e6b95a20462eaa205dee6f0bb1a9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.329462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.353798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 476/934] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:55:11 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/2caac9bd22464e2cbb6668357c0fe101/roles/0813e6b95a20462eaa205dee6f0bb1a9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:55:11.410494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 459/935] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:11.425818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.442867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.556619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639421-a50d-4654-968c-be64eb28c03b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.593355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.593986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.594260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.594621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.595191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.596551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:11.605797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:11.607029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.608182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 477/936] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:11.612880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.674174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.700752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.720180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6459f1-1520-40f2-8288-be567f1718ed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.766898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.767845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.768203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.768543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.769631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:11.770004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.771480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.778905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 460/937] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:11.784622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.795698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.837951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a57aa-df78-4874-8f2c-b59ee5d70096 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.885638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.887169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.887619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.888035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.889237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.891233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:11.904018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:11.905004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 14:55:11.905884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:11.910334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 478/938] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:11.914379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:11.923649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed1e34-8529-4e1c-90c8-630eae72f157 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:11.950886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:11.963429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:11.964178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:11.964558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:11.964933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:11.965685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:11.966094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:11.968124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:11.973597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 461/939] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:11.979642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:12.029293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91469-1a4e-4adc-bfcf-cd36a7e9b1aa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:12.066844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:12.067869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:12.068364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:12.068856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:12.069721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:12.070378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:12.071958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:12.074414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:12.079193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 479/940] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:12.089651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:12.105229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f4008-4e29-4a66-8a0e-85fda60eb59a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:12.142651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:12.143436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:12.143816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:12.144187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:12.144989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] RBAC: Adding query filter params (interface=public, service_id=fc5d22c88e0d4f9f869337c9a3f76dae, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:12.145399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:12.146899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:12.153391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 462/941] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:55:11 2022] GET /identity/v3/endpoints?service_id=fc5d22c88e0d4f9f869337c9a3f76dae&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:12.159190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:12.209037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2079c-08c1-4e98-8207-16811d4c9564 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:12.224408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:12.249198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:12.250086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:12.250997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:12.251684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:12.253128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:12.253835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:12.255756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:12.266240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 480/942] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:12.267365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:12.277950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772cd4-9e6f-43c8-ab62-f082f8e3cae5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:12.323403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:12.324664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:12.324941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:12.325494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:12.326116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:12.327804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3e85b-117c-48e3-a350-3014f70065ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:12.338490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 463/943] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:12 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 14:55:12.350567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:12.394007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687b27-2383-4d47-9fc8-be1a18326bf0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:12.432007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:12.432640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:12.432916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:12.433179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:12.433855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:12.435278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398864c-efef-469d-b6ac-5f987751d55e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:12.462041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 481/944] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:13.628029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7446-ff1a-4734-b4f7-b666d368cfb4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:13.628581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7446-ff1a-4734-b4f7-b666d368cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:13.628581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7446-ff1a-4734-b4f7-b666d368cfb4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:13.630028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 464/945] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:13.635551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:13.635952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:13.636119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:13.655617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:13.656837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:13.693865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3d-5f86-4d7d-92da-f05f0ee40598 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:13.694169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3d-5f86-4d7d-92da-f05f0ee40598 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:13.694435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3d-5f86-4d7d-92da-f05f0ee40598 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:13.696736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 465/946] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:13.703450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:13.703843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:13.704217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:13.724932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:13.726598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:13.740458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 482/947] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:13.806387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 466/948] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:14.010644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.061306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.076791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.130587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df03cb-2e93-47f5-b041-cd73ce7200d5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.133690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.171079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.172106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.172588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.173184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.174039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.175829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.179294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING keystone.server.flask.common [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 14:55:14.197852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeeadb-4396-4961-be43-58e9ced3e613 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.198995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 14:55:14.198995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 14:55:14.198995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [parameters: {'id': 'd9cf436499ff47cdb7063863019d8dce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 14:55:14.198995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9cf436499ff47cdb7063863019d8dce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9cf436499ff47cdb7063863019d8dce. Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:55:14.220112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 14:55:14.221032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Sep 11 14:55:14.221991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 14:55:14.222918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 14:55:14.224511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:55:14.225307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'id': 'd9cf436499ff47cdb7063863019d8dce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.226719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:14.228279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9cf436499ff47cdb7063863019d8dce. Sep 11 14:55:14.230420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.233475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 483/949] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 14:55:14 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:14.233736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.242061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.242061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.242061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.242605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.246920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:14.252151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:14.253314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:14.255100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 467/950] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:14.264438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.354183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1806-b965-44ee-820b-eb8bb96bc1f5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.356247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.383485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e860065-d79b-4aeb-9e22-e2975b90a35a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.393192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.397806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.398664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.399112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.399538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.407210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.409144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:14.421757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:14.422772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:14.423646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:14.424061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.424061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.424345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.424421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.425619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:14.425995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.427150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 484/951] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:14.431207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.433710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.449104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 468/952] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:14.450430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.555865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac00d84-b0d8-4ed3-8785-ac2433ce766a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.584159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2339-07e8-4341-b990-6549d83604e8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.589991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.590634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.590912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.591181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.591847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:14.592146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.593584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a006e-6970-49aa-8ecf-17402c8f6fcf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.624124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.624781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.625058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.625329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.626619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 485/953] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:14.628088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c160c-04a0-434a-af9d-c204d4bb531f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.628387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c160c-04a0-434a-af9d-c204d4bb531f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.628664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c160c-04a0-434a-af9d-c204d4bb531f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.629999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 486/954] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:14.636128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd74bb-72a4-49e5-91b9-d129d771d28b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.636756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd74bb-72a4-49e5-91b9-d129d771d28b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.636756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd74bb-72a4-49e5-91b9-d129d771d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.643519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.645830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.657808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8bdd74bb-72a4-49e5-91b9-d129d771d28b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:14.659496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8bdd74bb-72a4-49e5-91b9-d129d771d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:14.666108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:14.667454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:14.668405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:14.668405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:14.668405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:14.670886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 469/955] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:14.679957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.697127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.708533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.765104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 487/956] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:14.787156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd776c0-5156-47d1-9483-9dd90f3e2ca1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.787448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd776c0-5156-47d1-9483-9dd90f3e2ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.787726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd776c0-5156-47d1-9483-9dd90f3e2ca1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.790417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 488/957] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:14.795273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.795660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.795939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.801746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3d5-8e9f-418d-adac-b4a624c647b9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:14.817611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:14.820675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:14.843077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:14.843968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:14.844473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:14.844706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:14.845447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:14.845854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:14.847241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:14.859201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 470/958] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:14.864552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:14.910213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 489/959] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:14.960573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:14.985788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc12-76f7-406a-a7fd-ceaeecbc41c8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.022416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.023667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.023948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.024218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.032027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.033461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:15.045213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:15.046127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.047216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 471/960] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:55:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:15.052382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.059948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.137775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.158834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742560-f8b3-495f-8bf7-43e034dc2d37 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.166852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3943d67-e4e5-47e1-a6dd-1a7119288011 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.196865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.197471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.197750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.198014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.198780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:15.199078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.200505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.202473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.203134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.203413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.203686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.204267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.205615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:15.216459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:15.217708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.218589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 472/961] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:15.219406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.221340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 490/962] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:15.223285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.230571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.334922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f0cb3-b9be-4f52-b206-47a6e71a09ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.340221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6dde2-da2a-4345-be26-3478beb10e63 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.373473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.374283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.374717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.374989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.375785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:15.376185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.377059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.377637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.377738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.377950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.378220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.378830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.380173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.383649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 491/963] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:15.387118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.391521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:15.395416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:15.396414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:15.399449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 473/964] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:15.400438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.471250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.495825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c10e4-7ba3-42eb-adec-14e52919444d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.513634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2213d-5747-4379-a087-ee0dd3033e30 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.531529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.532168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.532418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.532685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.557412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.558746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.559257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.559718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.560587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:15.561081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.562705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.567827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 474/965] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:15.568851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.619503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.621586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.624761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.674710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953140c4-5c4f-4d16-b520-3add55c76aae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.707392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.713978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.714925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.715204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.715472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.716096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:15.716395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.718209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.729435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 475/966] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:15.729435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.735558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 492/967] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:15.736876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.832481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504604-89cd-43a3-930c-8e33d2efe89d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.839598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401afa-57f0-42c0-b092-250e7d58e289 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:15.841910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:15.869759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.870388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.870666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.870927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.871607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.873062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.876087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:15.876688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:15.876962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:15.877229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:15.877847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:15.878144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:15.879527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:15.884864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 493/968] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:15.885634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:15.905696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 476/969] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:16.028478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572592-4b67-4d1f-8171-4c7ac787a5b5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:16.079405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:16.080134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:16.080414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:16.080740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:16.093149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:16.094681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:16.111970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:16.112965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:16.113850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:16.113850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:16.113850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:16.113850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 494/970] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:16.120310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:16.176181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:16.230089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952436f4-dcfe-4390-8e75-3d4e12e77ded None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:16.265154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:16.265764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:16.266036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:16.266322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:16.266964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:16.267262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:16.268669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:16.281031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 477/971] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:16.286574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:16.306231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:16.398310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938df8-0df3-465c-997f-68ef0fa4377f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:16.434492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:16.435131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:16.435411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:16.435680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:16.443605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:16.445879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:16.457870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:16.458794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:16.459665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:16.462026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 495/972] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:16.467553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:16.578741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5eb2-c492-484d-a928-fcc7a92c23a0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:16.592720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:16.614867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:16.615484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:16.615765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:16.616097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:16.617315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:16.617621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:16.619067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ea226-1ed2-4660-a36f-e7619fa56439 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:16.631322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 478/973] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:16.637027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:16.720754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:16.745067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f7da-9fc3-428c-8dbe-f529ec7b9ed6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:16.780765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:16.781456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:16.781737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:16.782011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:16.782819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] RBAC: Adding query filter params (role.id=0813e6b95a20462eaa205dee6f0bb1a9, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=2caac9bd22464e2cbb6668357c0fe101) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:16.783134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:16.784576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d108c-fdb4-497f-8012-d5fe9af3ec06 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:16.791197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 496/974] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:16 2022] GET /identity/v3/role_assignments?user.id=2caac9bd22464e2cbb6668357c0fe101&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=0813e6b95a20462eaa205dee6f0bb1a9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:17.064273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdb5a-b716-4c60-8b17-b1150eacebdb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:17.064784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdb5a-b716-4c60-8b17-b1150eacebdb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:17.064859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdb5a-b716-4c60-8b17-b1150eacebdb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:17.066170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 479/975] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:17.072552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:17.072846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:17.073126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:17.091721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:17.092916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:17.160891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 497/976] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:17.432060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdb5a-b716-4c60-8b17-b1150eacebdb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:17.539181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdb5a-b716-4c60-8b17-b1150eacebdb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:17.574979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:17.575608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:17.575871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:17.576145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:17.576786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:17.578207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:17.580767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING keystone.server.flask.common [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 14:55:17.593996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 14:55:17.593996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 14:55:17.593996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [parameters: {'user_id': 'afb41225faa5404d904c7148c0128a20', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 14:55:17.593996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 11 14:55:17.601466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:55:17.602358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 14:55:17.603323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 14:55:17.604208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 14:55:17.605081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 14:55:17.607776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'user_id': 'afb41225faa5404d904c7148c0128a20', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:17.609759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 14:55:17.611681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:17.619695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 480/977] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 14:55:17 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:17.620616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:17.681274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:17.713911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6fc3-847b-4cb9-8a54-54a0a0f564d5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:17.752403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:17.753177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:17.753365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:17.753563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:17.761190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:17.762717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3cc83046-d87f-42a7-a24f-8f863a12cfe9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:17.774679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:17.776798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 14:55:17.779101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:17.782332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 498/978] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:55:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:17.782512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:17.818873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:17.893398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd1f3-a5b5-48fe-8fb0-6662442e264e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:17.929998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:17.930649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:17.930930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:17.931251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:17.932010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:17.932360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:17.934041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ddfe8-4520-40eb-aa14-3616260004d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:17.972408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 481/979] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 14:55:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:18.297799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fd90-44a7-4b70-a119-14fac4d7e3ae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.297799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fd90-44a7-4b70-a119-14fac4d7e3ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.297799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fd90-44a7-4b70-a119-14fac4d7e3ae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.297799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 499/980] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:18.300017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acdad-db41-4e8b-9835-856201e8219e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.300485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acdad-db41-4e8b-9835-856201e8219e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.300723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acdad-db41-4e8b-9835-856201e8219e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.306635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 482/981] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:18.306821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.306821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.306821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.307443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.307710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.307983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.323297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:18.324482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:18.327993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:18.329484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:18.402453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 500/982] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:18.404697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 483/983] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:18.667038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:18.676680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:18.708239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:18.737676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:18.781070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef710e-c371-4992-aab0-2cab0ed3a82c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:18.794996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba592-ab8e-4092-b30e-5e72ec6e9c29 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:18.818529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:18.819164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.820165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.820440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.821411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:18.823297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:18.831409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:18.832015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:18.832294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:18.832564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:18.833188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:18.834124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:18.839208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:18.839970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:18.840131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 501/984] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:18.840203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:18.840465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:18.855469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 484/985] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:18 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:18.957209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29e97-40f1-4d0e-b585-b26b7f6f9e81 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:18.988902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:19.010415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.011040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.011315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.011584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.012221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:19.012522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.013913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473a260-9eb6-4d17-91b7-5797f425d02e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.024488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 502/986] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:19.025568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.035428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7fd0-9bb8-4fbf-99f9-4a4e743bc31d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.035711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7fd0-9bb8-4fbf-99f9-4a4e743bc31d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.035979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7fd0-9bb8-4fbf-99f9-4a4e743bc31d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.037447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 503/987] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:19.042256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.042571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.042841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.062156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:19.063378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:19.120669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:19.150005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 504/988] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:19.150200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db306e-eab2-40b3-b88c-0c53b58fa8e4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.178449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.179666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.179943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.180206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.180820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:19.181117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.182502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.187582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 485/989] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:19.193116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.293072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08e095-1fdd-468c-8293-2f2631d700cd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.306895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:19.328503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.329106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.329376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.329644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.330383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] RBAC: Adding query filter params (interface=admin, service_id=fc5d22c88e0d4f9f869337c9a3f76dae, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:19.330689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.332036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.337755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 505/990] 10.222.0.16 () {56 vars in 1249 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/endpoints?service_id=fc5d22c88e0d4f9f869337c9a3f76dae&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:19.343194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.410948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.452062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ae1fb-af8a-4422-8e0a-75a90ef625be None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.489088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.489702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.489977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.490245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.490884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.492302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.499555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 486/991] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:55:19.521687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc081-286b-4922-99d4-44ee0475e8f0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.561318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.561886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.562165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.562469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] PATH_INFO: `/v3/services/image` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.563074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.564470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:19.574358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:19.575450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:19.576367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 506/992] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:19.583476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.597946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:19.694289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed60b-4540-4969-abce-f17267d3383c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.729018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.729623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.729925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.730384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.731006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:19.731393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.732747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09182f8a-edd0-4eaa-9fc1-d3785f4b3ce5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.737692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 487/993] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:19.743673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:19.789277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:19.847512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa7e1-6827-4a12-b399-5871aa277b92 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:19.881510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:19.882702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:19.882980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:19.883246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:19.883870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] RBAC: Adding query filter params (type=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:19.884170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:19.885525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c576f-b337-445c-8f6f-e1f3b77dcb5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:19.890058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 507/994] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:21.058727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a730d3-b4e6-4408-95e5-ab8ac5a10fb7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.059236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a730d3-b4e6-4408-95e5-ab8ac5a10fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.059311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a730d3-b4e6-4408-95e5-ab8ac5a10fb7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.060768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 488/995] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:21.065951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.066426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.066607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.087102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:21.088285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:21.156290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 508/996] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:21.424104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a730d3-b4e6-4408-95e5-ab8ac5a10fb7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:21.500312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:21.528021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a730d3-b4e6-4408-95e5-ab8ac5a10fb7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:21.561866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:21.562552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.562831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.563099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.563694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:21.565107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-49f390d1-7fcd-4b87-a949-47f17b5daabf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:21.575292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:21.576429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:21.577270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:21.581653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 489/997] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:21.583078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:21.618738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:21.686632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933153d-a1a9-4728-ab61-8c3641086999 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.686831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933153d-a1a9-4728-ab61-8c3641086999 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.687080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933153d-a1a9-4728-ab61-8c3641086999 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.688568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 490/998] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:21.692819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a055a3-0ae2-4227-9d29-9f911e7ac9ed None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:21.693321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.693607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.693881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.712642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:21.713828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:21.728333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:21.728935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.729211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.729477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.730091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:21.730419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:21.731809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:21.736733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 509/999] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:21.741951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:21.783179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 491/1000] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:21.842376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:21.845953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1161-327a-405e-a5dc-4778513cf973 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:21.881101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:21.881703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:21.882557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:21.882818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:21.883484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:21.883785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:21.885149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b2412-daef-48a8-914d-0fe33281aebe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:21.890383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 510/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:21.896116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:21.972385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:22.008546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64ccc2-f07a-4172-b00c-ffedf13004b4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.040856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc855fa-c757-4266-8eea-1d070f947e6d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.041129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc855fa-c757-4266-8eea-1d070f947e6d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.041397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc855fa-c757-4266-8eea-1d070f947e6d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.042768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 511/1002] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:22.047423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.047721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.048005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.048105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.048285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.048383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.048546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.049241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] RBAC: Adding query filter params (interface=public, service_id=0c2409272cfe45dcabf902099cc6b899, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:22.049546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.051029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.056612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 492/1003] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:55:21 2022] GET /identity/v3/endpoints?service_id=0c2409272cfe45dcabf902099cc6b899&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:22.057387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.068857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:22.070066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:22.135030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 512/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:22.135859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.159910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b975e0-8023-4259-ad8c-4676a8f3215e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.189812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:22.196481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.197227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.197504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.197777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.198383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.199742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:22.208389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:22.209330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:22.215084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 493/1005] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 14:55:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:22.215996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.247248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:22.254833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5e15-fb2d-4f6b-96c6-46ad1dee712a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.290692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.291573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.292031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.292505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.293104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.294512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.301007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 513/1006] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:22 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:55:22.324480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2efee-8fcc-4bc8-b59d-5bb92d012b1e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.362607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.363248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.363529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.363799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.364442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:22.364748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.366232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.376685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 494/1007] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:22.377741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.402574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.474513 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:22.489355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f65a7-24e6-4652-b790-dee0a7481c77 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.526724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3112-8794-4d75-b044-ade75e3ba678 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.528539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.529154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.529425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.529687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.530330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:22.530630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.531991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.537159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 514/1008] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 14:55:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:22.542638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:22.563357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.563963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.564243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.564514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.565176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.566562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dea03-0ba8-4baf-ab9c-626d4472660a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.568345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:22.585376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 495/1009] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:22 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:22.658030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3154bc-cb77-4c6c-929b-12012fc8acf7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:22.701590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:22.702211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:22.702530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:22.702803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:22.703471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:22.704882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419cd8b-5302-4322-9e42-4703e3731899 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:22.723993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 515/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:24.499293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594d54-34d1-4e82-84a8-9a7fd80b1378 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.499874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594d54-34d1-4e82-84a8-9a7fd80b1378 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.499874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594d54-34d1-4e82-84a8-9a7fd80b1378 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.501186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 496/1011] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:24.507328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f067-d19b-4804-9ba9-de1460f08528 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.507754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f067-d19b-4804-9ba9-de1460f08528 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.507850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f067-d19b-4804-9ba9-de1460f08528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.526808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0991f067-d19b-4804-9ba9-de1460f08528 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:24.528703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0991f067-d19b-4804-9ba9-de1460f08528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:24.603801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 516/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:24.776085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d623-a24b-47ab-802f-b15f546903eb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.776286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d623-a24b-47ab-802f-b15f546903eb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.776536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d623-a24b-47ab-802f-b15f546903eb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.778082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 497/1013] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:24.783904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f17-0959-4dc4-969f-c29652c0ef60 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.784186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f17-0959-4dc4-969f-c29652c0ef60 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.784460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f17-0959-4dc4-969f-c29652c0ef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.791879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:24.805802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ab34f17-0959-4dc4-969f-c29652c0ef60 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:24.807013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ab34f17-0959-4dc4-969f-c29652c0ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:24.871533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d623-a24b-47ab-802f-b15f546903eb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:24.875235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 517/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:24.878712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e52bb-73a7-430e-9b57-552a61f4f21a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.879000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e52bb-73a7-430e-9b57-552a61f4f21a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.879269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e52bb-73a7-430e-9b57-552a61f4f21a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.881116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 518/1015] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:24.886421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:24.886704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:24.886976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:24.906597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:24.907877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:24.986398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 519/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:24.991234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d623-a24b-47ab-802f-b15f546903eb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.010898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.027419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.027981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.028254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.028518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.029090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.030463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:25.039049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:25.040103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.043388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 498/1017] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:25.046246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.108706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.147197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae312-a771-44d4-a637-d547f74b4be1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.153468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.186330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.186936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.187239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.187533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.188089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:25.188385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.189742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.194586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 520/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:25.200107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.269542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6364-af16-4a45-a5dc-aca0c9ce69cd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.297166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb877d1c-2deb-4550-aea2-8116e7a689f0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.303345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.304553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.304832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.305099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.305667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.307037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:25.315505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:25.316649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:25.317494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 499/1019] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:25.318315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.327898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.336240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.336838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.337110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.337376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.337990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:25.338311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.339660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.344281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 521/1020] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:25.345019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.372880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.430444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c466c-3489-4af1-b6dd-79fbeedebb81 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.443538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be335-fc2c-431c-90d6-95cd3db1f556 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.464320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.464941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.465218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.465484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.466607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.468022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.469572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 500/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:25.470320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.479643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.480241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.480514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.480780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.481440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:25.481804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.483338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.491148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 522/1022] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:25.492176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.550161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.569848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558b3fe-3b5b-4224-8f93-7dfb7a393774 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.585655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.594492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29b7c-285b-43cf-a106-2ce05fcc2ce5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.604163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.604758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.605037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.605311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.605963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.607348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.626686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 501/1023] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:25.627471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.648527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.649462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.649740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.650006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.650707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.652166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.684096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 523/1024] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:25 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:25.762322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffca3b-0a2c-472f-878b-7dd374629469 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.801337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.802612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.803090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.804133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.805000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:25.805452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.807060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.813130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 502/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:25.820093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:25.927328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ef75-6e21-4a38-b567-2610244f5d5a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:25.929807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:25.965701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:25.966455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:25.966739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:25.967014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:25.967726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] RBAC: Adding query filter params (interface=public, service_id=35e9fc2e76be43f889d30270c3fc3897, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:25.968046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:25.969413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517502b-0458-4754-92e6-6c91c1bd9570 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:25.977036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 524/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/endpoints?service_id=35e9fc2e76be43f889d30270c3fc3897&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:25.982677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:26.019522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:26.089353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5c8d5-e974-489a-a26c-ef35cda7a2d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:26.123871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:26.124483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:26.124762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:26.125031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:26.125633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:26.127028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90402-a567-47a9-b122-54df1e1f79e4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:26.140391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 503/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:55:25 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:55:27.894574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d855e-f3ab-46df-b032-05f76c88147a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:27.895105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d855e-f3ab-46df-b032-05f76c88147a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:27.895105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d855e-f3ab-46df-b032-05f76c88147a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:27.896612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 525/1028] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:27.902588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:27.903009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:27.903182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:27.921049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:27.922224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:27.987610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5092-0466-414e-902b-596252490388 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:27.988027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5092-0466-414e-902b-596252490388 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:27.988304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5092-0466-414e-902b-596252490388 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:27.989765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 526/1029] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:27.996517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd22912-9202-43bd-bc87-a745fef819b0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:27.997039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd22912-9202-43bd-bc87-a745fef819b0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:27.997376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 504/1030] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:27.997738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd22912-9202-43bd-bc87-a745fef819b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.017718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6fd22912-9202-43bd-bc87-a745fef819b0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:28.018942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6fd22912-9202-43bd-bc87-a745fef819b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:28.089039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 527/1031] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:28.264122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.294312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.304905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b615f-183d-49a2-be2d-8b1bf0be8a44 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.305191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b615f-183d-49a2-be2d-8b1bf0be8a44 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.305467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b615f-183d-49a2-be2d-8b1bf0be8a44 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.306855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 528/1032] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:28.311596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.311870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.312146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.330660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:28.331838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:28.366051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbebdb-f6ee-428f-9173-e54aca558b25 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.399554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.400184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.400477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.400743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.401881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:28.403343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:28.404470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 529/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:28.405312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.406298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 505/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:28.414976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.441483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.520375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.525545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6486b80-790e-4480-b03e-1e969cd10800 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.527120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d224e6-b355-485a-9436-ebc471659853 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.561870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.562192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.562501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.562778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.562875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.563044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.563149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.563325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.563678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:28.565093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:28.573397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:28.578148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:28.579163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:28.579989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 530/1035] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:28.586149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.591744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 506/1036] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:55:28 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:28.677488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.689098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.703719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1a60-5242-472b-bdb9-0c45c87cb241 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.742123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.742780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.743043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.743326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.744059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:28.744480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:28.745933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:28.756190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 531/1037] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:28.761766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.804781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd939a-ff80-4edd-a05e-2fb03d814132 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.846421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.847062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.847336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.847602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.848181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:28.849534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:28.858803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:28.859793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:28.860624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 507/1038] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:28.866029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.880782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc3626-9b36-4149-887e-bc5715b05da6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:28.887337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.917204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:28.917834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:28.918149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:28.918400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:28.929479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:28.930900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:28.945819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:28.946891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:28.951364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:28.951364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:28.951364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:28.951364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 532/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:28.952543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:28.955229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:28.992684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bd64-563c-4ec9-97a3-4439cc49d4aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.028249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.028862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.029140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.029412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.030044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:29.030384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.031753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.036778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 508/1040] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:29.042330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.061227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccab55-9b56-4263-b8fd-5a725c9a6635 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.100522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.101165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.101443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.101709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.102369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:29.102673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.104024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.116793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 533/1041] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:29.121991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.133353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:29.155898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924958-b8cf-4ab4-a422-cca6796320f9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.188525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:29.192785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.193404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.193683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.193977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.194650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:29.194957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.196327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.201242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 509/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:29.206803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.236329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e029-aae2-48f3-9b8f-8f083423b2ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.274254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.274932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.275205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.275472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.282570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.283997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:29.296726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:29.297722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:29.298766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 534/1043] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:29.304146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.315538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf912b69-3d1a-4884-b7d4-6f5e41b06972 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.353238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.353845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.354118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.354417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.355186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.356649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.390306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 510/1044] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:55:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 14:55:29.419705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8bb37-26dc-4493-abb2-54ec9dac2a45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.447202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:29.467857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.468487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.468766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.469038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.469779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:29.470086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.471579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.497036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 535/1045] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:29.498630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.501657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:29.613438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c20a7-8337-46d5-ad72-560edbf9eb7c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.648405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.649009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.649288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.649556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.717473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.718939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.720715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:29.819012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 511/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:29.824501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:29.926523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97b3c-838f-40f0-b139-f825dfaefe5f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:29.961364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:29.961992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:29.962283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:29.962567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:29.972721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:29.974463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:29.990151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:29.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:29.992639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:29.992639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:29.992639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:29.994574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 536/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:29.997466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:30.099051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a3f69-af68-445a-a772-c349bce19996 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:30.100714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:30.141579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:30.142188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.142490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.142764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.143397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:30.143702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:30.145054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:30.157100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 512/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:30.162528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:30.191353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:30.263993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aed0b-9ff8-4fe7-9309-0d67d3a942cc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:30.296801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:30.297435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.297711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.297980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.306179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:30.307705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:30.320562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:30.321538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:30.322480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:30.323554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 537/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:30.327527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:30.426812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3e67-d14d-4a20-bca8-dc3f01cc9558 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:30.462003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:30.462571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.462849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.463120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.463809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:30.464112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:30.465534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa3cb-55ca-4701-8bf4-7ef224438a21 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:30.478571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 513/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:30.484377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:30.573416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:30.587099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb988d3-f1cb-4b8d-9b37-4e44b3afb656 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:30.620866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:30.621470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.621757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.622013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.622758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] RBAC: Adding query filter params (role.id=0813e6b95a20462eaa205dee6f0bb1a9, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:30.623066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:30.624496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdced3f-0ad0-4fd6-9093-2011261ac42f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:30.634295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 538/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:30 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=0813e6b95a20462eaa205dee6f0bb1a9 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:30.819774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b43a-8985-49d5-a1d5-d1e1df1e0bef None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.819974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b43a-8985-49d5-a1d5-d1e1df1e0bef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.820307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b43a-8985-49d5-a1d5-d1e1df1e0bef None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.821699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 514/1052] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:30.827101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:30.827387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:30.827656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:30.846090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:30.847288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:30.914368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 539/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:31.181482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04b43a-8985-49d5-a1d5-d1e1df1e0bef None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:31.206291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:31.284348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04b43a-8985-49d5-a1d5-d1e1df1e0bef None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:31.317837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:31.318497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.318774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.319575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.329928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:31.334836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:31.335787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:31.336651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:31.338348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 515/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:31.342493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:31.422823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:31.442191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348e2c-1c24-457d-9e6a-1aabcc2f38df None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:31.477193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:31.477831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.478104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.478408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.479096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:31.479399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:31.480850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640f9e-da9d-4a83-8d2c-3eeb009f11a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:31.497221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 540/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:31.498743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:31.582912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:31.598198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99775d-797f-4acc-9925-a88658f28fcf None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.598516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99775d-797f-4acc-9925-a88658f28fcf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.598785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99775d-797f-4acc-9925-a88658f28fcf None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.600249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 541/1056] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:31.602558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e928f-05a5-4573-8649-01a758d6bc90 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:31.604847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.605127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.605397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.623377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:31.624570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:31.640356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:31.641054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.641386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.641746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] PATH_INFO: `/v3/users/7c9ff7385d5a40d8958c7810430ba3d1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.655786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] RBAC: Authorizing `identity:get_user(user_id=7c9ff7385d5a40d8958c7810430ba3d1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:31.657272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:31.663792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 516/1057] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/users/7c9ff7385d5a40d8958c7810430ba3d1 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:31.664983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:31.691743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 542/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:31.762781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebcc32-cdb2-419c-bb1d-90e421870c9f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:31.795182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:31.795850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:31.796191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:31.796523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:31.807397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:31.864870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:31.866953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:31.955567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:31.969741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 517/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:55:31.970774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:32.018402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:32.043560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:32.069829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a1e5b-78c6-450a-86a9-d980d329ef18 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:32.084026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3510dc-919c-4503-832b-d5c496ec015e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:32.102877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:32.103560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.103834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.104101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.121374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:32.122216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.122659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.123071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.124421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:32.125834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:32.127723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 518/1060] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:32.134282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:32.170283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:32.171751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:32.238557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ade7c-8189-4987-b2b0-449ba21d8f22 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:32.247800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:32.251028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:32.276873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:32.277664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.278001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.278302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.279043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=c263c3aee4244b15b0301384ef2da632, user.id=7c9ff7385d5a40d8958c7810430ba3d1) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:32.279349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:32.279852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 543/1061] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:55:32.280894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:32.285357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:32.294536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 519/1062] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:32 2022] GET /identity/v3/role_assignments?user.id=7c9ff7385d5a40d8958c7810430ba3d1&scope.project.id=c263c3aee4244b15b0301384ef2da632&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:32.389764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8c6b-db9f-4c59-be0b-52f079b93ecf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:32.425024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:32.425667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.425937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.426208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.438031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:32.439546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-218970e3-6e6f-4c4d-a4ee-d7b52b7396b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:32.455215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:32.456428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:32.457509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:32.457509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:32.457509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:32.462312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 544/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:32.463000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:32.562408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ead22-717e-49bf-ab13-623ea5dc9b28 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:32.594749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:32.595351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.595623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.595891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.596511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:32.596805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:32.598146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3335-93f5-41b2-9cda-df1ef17cdd2d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:32.610544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 520/1064] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:32.796018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6e7e-dc6a-40bf-93a7-9c89fe7faf88 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.796331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6e7e-dc6a-40bf-93a7-9c89fe7faf88 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.796566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6e7e-dc6a-40bf-93a7-9c89fe7faf88 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.797910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 545/1065] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:32.804126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:32.804415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:32.804690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:32.823845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:32.824972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:32.863388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:32.907844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 521/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:33.171620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6e7e-dc6a-40bf-93a7-9c89fe7faf88 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:33.200411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:33.273839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6e7e-dc6a-40bf-93a7-9c89fe7faf88 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:33.307055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:33.307668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:33.307940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:33.308202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:33.317908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:33.322635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:33.323568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:33.324404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 546/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:33.329680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:33.423930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaea5e-a52c-4a2e-b07d-4fc6214d5ebe None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:33.456443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:33.457034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:33.457309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:33.457579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:33.458230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:33.458559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:33.460480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:33.468270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 522/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:33.473772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:33.556545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:33.571577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dfd51-2227-4e77-bcc7-c771988b027e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:33.604116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:33.604734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:33.605006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:33.605271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:33.614833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:33.616290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:33.630060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:33.631073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:33.632534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:33.632534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:33.632534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:33.632534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 547/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:33.637342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:33.663030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:33.735995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80b58-fee5-4e72-9a4c-9faf458ad0e3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:33.767589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:33.768179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:33.768450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:33.768717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:33.769335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:33.769631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:33.770999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:33.782295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 523/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:33.787808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:33.884775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dfc8-d9ef-4d50-9ba6-7319137074c1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:33.917301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:33.917919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:33.918189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:33.918478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:33.925700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:33.927410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:33.929598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:33.939840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:33.940811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:33.941734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 548/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:33.947376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.035711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:34.052135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fed9-9196-49a3-8459-f2702082ac99 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.085906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.086541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.086815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.087082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.087791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:34.088090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.089500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.107606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 524/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:55:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:34.113412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.213329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0438cdc-fb65-468c-8225-b81cac749625 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.247398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.248016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.248292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.248608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.258897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.260330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:34.274603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:34.275739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:34.276747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:34.276747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:34.276747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:34.278428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 549/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:34.281393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.382458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e20e-b86e-48c7-80b9-4ef9cdbbe9c0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.415941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.416538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.416813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.417079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.417698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:34.417994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.419370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f2182-cde7-4e63-af6c-68967b69d69f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.430943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 525/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:34.436559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.474237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933902d-d511-40d1-8ee4-ef944961a1ac None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.474549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933902d-d511-40d1-8ee4-ef944961a1ac None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.474821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933902d-d511-40d1-8ee4-ef944961a1ac None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.476678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 526/1075] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:34.481405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.481685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.482829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.486452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:34.488221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:34.501612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:34.502828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:34.539445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74d22-42f1-4985-8fa8-56df4b0c4387 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.572412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.573037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.573311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.573578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.575107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 527/1076] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:34.580275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.581715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:34.593212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:34.594227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:34.595304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 550/1077] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:34.599933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.694761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62581-c0cb-40df-955e-1f78287777c4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.722908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:34.728961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.729557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.729831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.730099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.730835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:34.731137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.732546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.743734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 528/1078] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:34.749706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.842143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:34.847877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e6f2-c25b-48a3-ac5d-54ff1cc6a073 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.858578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:34.881937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.882609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.882882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.883147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/0813e6b95a20462eaa205dee6f0bb1a9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.885265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=456e7e3006f14407ac65e432ace7286d, role_id=0813e6b95a20462eaa205dee6f0bb1a9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:34.886715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:34.899910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 551/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:55:34 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/456e7e3006f14407ac65e432ace7286d/roles/0813e6b95a20462eaa205dee6f0bb1a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:55:34.945543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573583-6d20-402e-a6c0-a12ee9a09594 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:34.982275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:34.982959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:34.983238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:34.983509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:34.995934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:35.000789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:35.001794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:35.003928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 529/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:35.008258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:35.112455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65b796-a8f9-4e6f-80a5-107d61eb14bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:35.144829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:35.145432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:35.145707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:35.145972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:35.146654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:35.146978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:35.148325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:35.157117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 552/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:35.163769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:35.219621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:35.266967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591a2-c69d-4fba-8dca-4080195aa7cc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:35.299559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:35.300172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:35.300445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:35.300711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] PATH_INFO: `/v3/users/7c9ff7385d5a40d8958c7810430ba3d1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:35.302577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9ff7385d5a40d8958c7810430ba3d1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:35.303918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:35.305145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 530/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:35 2022] GET /identity/v3/users/7c9ff7385d5a40d8958c7810430ba3d1 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:35.310894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:35.341066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:35.408951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb763c8-5820-4b2a-8799-013812ea324b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:35.441671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:35.442318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:35.442591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:35.442854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:35.443967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:35.445373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960a0e-2be7-4c6e-bae3-a2c877406a7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:35.447010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 553/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:35 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:35.452854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:35.555472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005eb7-1bbc-4c1e-8bf6-542a4ccf2681 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:35.575054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:35.590202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:35.590889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:35.591168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:35.591442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632/users/7c9ff7385d5a40d8958c7810430ba3d1/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:35.593325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] RBAC: Authorizing `identity:create_grant(project_id=c263c3aee4244b15b0301384ef2da632, user_id=7c9ff7385d5a40d8958c7810430ba3d1, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:35.594785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c43e9-28c1-444a-94d1-c32fc61a6820 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:35.607856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 531/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:55:35 2022] PUT /identity/v3/projects/c263c3aee4244b15b0301384ef2da632/users/7c9ff7385d5a40d8958c7810430ba3d1/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:55:37.061227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97d6b-87ac-4a86-af86-32c62cc7516f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.061742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97d6b-87ac-4a86-af86-32c62cc7516f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.061742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97d6b-87ac-4a86-af86-32c62cc7516f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.063128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 554/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:37.068477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.069456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.069631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.087265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:37.088429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:37.152673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 532/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:37.424285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b97d6b-87ac-4a86-af86-32c62cc7516f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:37.528978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:37.532952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b97d6b-87ac-4a86-af86-32c62cc7516f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:37.567437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:37.568058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.568333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.568600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.579157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-dd58c234-41fa-466f-9120-944d6260bc74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:37.583835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:37.584873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:37.585785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 555/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 14:55:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:37.591033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:37.689606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a8a6f-68db-4de4-8bd4-66510c69f6b9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:37.700532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:37.719967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bcf3-5529-408f-b3e9-4622ab206a42 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.720242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bcf3-5529-408f-b3e9-4622ab206a42 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.720511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bcf3-5529-408f-b3e9-4622ab206a42 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.722589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 556/1088] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:55:37.724576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:37.725178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.725453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.725720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.726433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:37.726737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:37.727284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.727565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.727832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.728091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:37.738305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 533/1089] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:55:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:37.742135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:37.745999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:37.747207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:37.813292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 557/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:37.838454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d5c8-bb67-459c-a54c-d844b4c07510 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:37.870968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:37.871587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:37.871863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:37.872128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:37.882224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:37.883667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:37.897683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:37.903449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:37.904591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:37.904591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:37.904591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:37.904591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 534/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:37.904879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:37.994358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.004276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e6e2-57ab-4c66-a4cf-9e648abba378 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.037521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.038110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.038415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.038681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.039307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:38.039602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.040951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.051683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 558/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:38.057578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.085065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.086412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.160822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060502-eb89-40b5-9174-d5f0aefd59f6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.183250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65a07-79d9-41d8-960b-f597eebcf94f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.194380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.195002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.195278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.195545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.202891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.204323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:55:38.215724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:38.221476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:38.222729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 535/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:38.223489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.223489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.223489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.223489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.224465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.234399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:55:38.240154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:38.241183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:55:38.242382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 559/1094] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:38.247031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.259965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.308753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.325140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d494c81-4aff-475d-b5f2-fb02b92b0a91 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.346177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88f988-d1bd-4ea7-a24b-0c907289a4c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.357821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.358450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.358725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.358995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.359704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:38.360005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.361414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.378458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 536/1095] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:38.378917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.379597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.379878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.380147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.380803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:38.381101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.383066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.384713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.396690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 560/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:38.397670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.465488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.483353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a6299-fc07-4d2e-bb79-3ed5e718034d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.497836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d93e-c4c1-47b5-8e18-b8dfca6d9e13 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.523559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.524161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.524432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.524700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.533215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.533958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.534238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.535329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] PATH_INFO: `/v3/users/7c9ff7385d5a40d8958c7810430ba3d1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.536400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.537018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9ff7385d5a40d8958c7810430ba3d1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.538670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.540280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 561/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/users/7c9ff7385d5a40d8958c7810430ba3d1 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:38.545884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.594911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.596340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.643981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8148-58d2-44d1-828d-8558d0ab7539 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.677618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.678866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.679171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.679441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.689498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.696792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 537/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:55:38.697794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.738155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.747313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.748825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.795693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba6ee-5400-47b3-a1b6-4825d2ca1e4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.837320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.837952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.838231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.838533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.845971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 562/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:55:38.849391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.851171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.851900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:55:38.865611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:38.866779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:55:38.867973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:55:38.867973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:55:38.867973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:38.867973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 538/1100] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:55:38.872092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:38.894579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.951547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781158-5e86-41de-9d8c-e9dd54acd59e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.964525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:38.972262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9dcb-a0c0-4cd5-b5c4-cebcb76a4590 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:38.987315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:38.987944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:38.988219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:38.988486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:38.989590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:38.991041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:38.992660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 563/1101] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:38.998544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:39.008350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:39.008898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:39.009181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:39.009454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:39.010082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:39.010441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:39.011796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:39.024145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 539/1102] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:39.030094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:39.095061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fad69-8c59-469b-b776-2c6208c8bac6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:39.104412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:39.125553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363d1fe-b28b-4f17-a28f-0e1e51dc4f0c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:39.128954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:39.129550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:39.129824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:39.130110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:39.130856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=c263c3aee4244b15b0301384ef2da632, user.id=7c9ff7385d5a40d8958c7810430ba3d1) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:39.131219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:39.132651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:39.138521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 564/1103] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:38 2022] GET /identity/v3/role_assignments?user.id=7c9ff7385d5a40d8958c7810430ba3d1&scope.project.id=c263c3aee4244b15b0301384ef2da632&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:55:39.167472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:39.168130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:39.168402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:39.168667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:39.176206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:39.177915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:55:39.189813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:55:39.190852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:55:39.191764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:55:39.194460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 540/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:55:39.197040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:39.302908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05817-407c-4c73-b05a-c56b7f2b3f4d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:39.336609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:39.337215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:39.337491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:39.337758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:39.338470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:39.338771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:39.340224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943075ab-e613-4e32-9cd2-445891defa03 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:39.352657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 565/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:39.358964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:39.375097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:39.456002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3992-9028-4960-bedf-387e1abbbf7a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:39.489502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:39.490102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:39.490411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:39.490683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:39.491394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] RBAC: Adding query filter params (role.id=0813e6b95a20462eaa205dee6f0bb1a9, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=456e7e3006f14407ac65e432ace7286d) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:39.491699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:39.493120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e432f-71f3-4e81-aeed-79fd363fe04f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:39.499205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 541/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:39 2022] GET /identity/v3/role_assignments?user.id=456e7e3006f14407ac65e432ace7286d&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=0813e6b95a20462eaa205dee6f0bb1a9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:41.311967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ba2-795c-4e79-b853-cb52a511e464 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:41.312480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ba2-795c-4e79-b853-cb52a511e464 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:41.312480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ba2-795c-4e79-b853-cb52a511e464 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:41.313817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 566/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:41.319868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:41.320275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:41.320405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:41.337974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:41.339167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:41.403175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 542/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:55:41.682713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a173ba2-795c-4e79-b853-cb52a511e464 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:41.712695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:41.781611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a173ba2-795c-4e79-b853-cb52a511e464 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:41.813863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:41.814504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:41.814781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:41.815049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:41.816143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:41.817570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2660-7cf4-4101-85cf-95459c189dff None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:41.819673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 567/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:41.825296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:41.835812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:41.920070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af651b-f728-4cae-b8e5-fedfc9d68e41 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:41.952264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:41.952790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:41.953065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:41.953332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:41.953960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:41.955396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10c71-9606-4b6e-a297-b7f50a945fe9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:41.976431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 543/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:55:41 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:44.118224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3162-3f2a-4537-811b-0790caca1319 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:44.118759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3162-3f2a-4537-811b-0790caca1319 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:44.118937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3162-3f2a-4537-811b-0790caca1319 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:44.120181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 568/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:44.125270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:44.125686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:44.125816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:44.143957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:44.145125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:44.203015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:44.214355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 544/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:44.482553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3162-3f2a-4537-811b-0790caca1319 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:44.579626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:44.583574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3162-3f2a-4537-811b-0790caca1319 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:44.615834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:44.616447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:44.616719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:44.616986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] PATH_INFO: `/v3/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:44.618371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] RBAC: Authorizing `identity:get_role(role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:44.619719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:44.621014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 569/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:44 2022] GET /identity/v3/roles/dc8bbaa1778e437ab64402e812b88365 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:44.626828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:44.724244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504055e-77c9-49dd-ab1e-3bc53e072124 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:44.757390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:44.757948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:44.758220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:44.758516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] PATH_INFO: `/v3/users/bc42ac7594354affb6556290bd6da4d8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:44.770823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] RBAC: Authorizing `identity:get_user(user_id=bc42ac7594354affb6556290bd6da4d8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:44.772263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:44.773809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 545/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:44 2022] GET /identity/v3/users/bc42ac7594354affb6556290bd6da4d8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:44.779426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:44.873925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd9f48-a57c-43ff-bb4a-6c16b5c843d9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:44.905310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:44.905895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:44.906167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:44.906460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:44.939888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:44.970733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:44.972167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:45.066196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 570/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:45.072506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:45.121798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:45.165686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aface-d65d-416d-9528-89282f453cbd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:45.198518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:45.199128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:45.199404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:45.199672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:45.200755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:45.202154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd771a7b-3635-45d7-b644-6accff9ed1b0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:45.203742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 546/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:45 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:45.209611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:45.274875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:45.307668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74445-2c25-46b5-a985-483981dca4d6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:45.340548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:45.341087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:45.341361 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:45.341627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:45.342388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=c263c3aee4244b15b0301384ef2da632, user.id=bc42ac7594354affb6556290bd6da4d8) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:45.342696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:45.344109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746689-5108-44c6-864a-4f15aebdb2ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:45.349290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 571/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:45 2022] GET /identity/v3/role_assignments?user.id=bc42ac7594354affb6556290bd6da4d8&scope.project.id=c263c3aee4244b15b0301384ef2da632&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:47.447464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad238d-d2e8-4bcb-a6a4-97f1dea2f69b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:47.448009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad238d-d2e8-4bcb-a6a4-97f1dea2f69b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:47.448009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad238d-d2e8-4bcb-a6a4-97f1dea2f69b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:47.449343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 547/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:47.454604 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:47.455020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:47.455129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:47.472709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:47.473889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:47.537304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 572/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:47.807031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad238d-d2e8-4bcb-a6a4-97f1dea2f69b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:47.905377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad238d-d2e8-4bcb-a6a4-97f1dea2f69b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:47.929084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:47.942936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:47.943585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:47.943863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:47.944134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] PATH_INFO: `/v3/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:47.945511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] RBAC: Authorizing `identity:get_role(role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:47.946889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:47.948205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 548/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:47 2022] GET /identity/v3/roles/dc8bbaa1778e437ab64402e812b88365 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:47.954059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:48.013175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:48.049905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137320-c7a1-46f8-907e-010dcecf085a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:48.082980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:48.083532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:48.083806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:48.084115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] PATH_INFO: `/v3/users/bc42ac7594354affb6556290bd6da4d8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:48.085205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] RBAC: Authorizing `identity:get_user(user_id=bc42ac7594354affb6556290bd6da4d8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:48.086654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:48.088205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 573/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:47 2022] GET /identity/v3/users/bc42ac7594354affb6556290bd6da4d8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:48.093925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:48.190092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692c13c-fb1e-408d-a5ec-ef164c262b04 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:48.222650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:48.223263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:48.223542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:48.223812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:48.225028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:48.226464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2823-ce09-42c8-96b8-729eb0cabf60 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:48.228165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 549/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:48 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:48.233989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:48.330705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90855-a07d-4e12-b710-9cf9bd546178 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:48.357656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:48.363631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:48.364275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:48.364546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:48.364812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632/users/bc42ac7594354affb6556290bd6da4d8/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:48.367422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] RBAC: Authorizing `identity:create_grant(project_id=c263c3aee4244b15b0301384ef2da632, user_id=bc42ac7594354affb6556290bd6da4d8, role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:48.368841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c08b4-2a92-4083-a0c3-65b38149eb5a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:48.381842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 574/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:55:48 2022] PUT /identity/v3/projects/c263c3aee4244b15b0301384ef2da632/users/bc42ac7594354affb6556290bd6da4d8/roles/dc8bbaa1778e437ab64402e812b88365 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:55:50.505947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac401-e0f7-40dd-acfa-7f6a70f471bd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:50.506501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac401-e0f7-40dd-acfa-7f6a70f471bd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:50.506589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac401-e0f7-40dd-acfa-7f6a70f471bd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:50.507892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 550/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:50.513050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:50.513484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:50.513583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:50.531887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:50.533061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:50.597814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 575/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:50.869115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ac401-e0f7-40dd-acfa-7f6a70f471bd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:50.925399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:50.968225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ac401-e0f7-40dd-acfa-7f6a70f471bd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:51.000314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:51.000932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:51.001206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:51.001476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] PATH_INFO: `/v3/roles/dc8bbaa1778e437ab64402e812b88365` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:51.002866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] RBAC: Authorizing `identity:get_role(role_id=dc8bbaa1778e437ab64402e812b88365)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:51.004209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:51.005512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 551/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:50 2022] GET /identity/v3/roles/dc8bbaa1778e437ab64402e812b88365 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:51.011755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:51.105581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159782-46bf-41e8-9a7a-3441acd19563 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:51.124817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:51.139397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:51.140005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:51.140276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:51.140540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] PATH_INFO: `/v3/users/bc42ac7594354affb6556290bd6da4d8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:51.141649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] RBAC: Authorizing `identity:get_user(user_id=bc42ac7594354affb6556290bd6da4d8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:51.143079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:51.144608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 576/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:55:51 2022] GET /identity/v3/users/bc42ac7594354affb6556290bd6da4d8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:51.150230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:51.245015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12457dea-66eb-4c6e-94b5-e52faea2f9eb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:51.268103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:51.278723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:51.279311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:51.279585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:51.279851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:51.346033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:51.347521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:51.441658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 552/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:55:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:55:51.447670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:51.542072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86251-47b8-4f4d-802b-351ab17eb4ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:51.574747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:51.575356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:51.575628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:51.575900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] PATH_INFO: `/v3/projects/c263c3aee4244b15b0301384ef2da632` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:51.576995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=c263c3aee4244b15b0301384ef2da632)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:51.578437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d949b-b463-430c-bce0-b6fed591c0f7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:51.580028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 577/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:55:51 2022] GET /identity/v3/projects/c263c3aee4244b15b0301384ef2da632 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:51.585962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:51.609687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:51.681858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc367f6c-f17e-45fa-9379-bf17ae4ce4c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:51.713675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:51.714206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:51.714510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:51.714779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:51.715485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] RBAC: Adding query filter params (role.id=dc8bbaa1778e437ab64402e812b88365, scope.project.id=c263c3aee4244b15b0301384ef2da632, user.id=bc42ac7594354affb6556290bd6da4d8) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:55:51.715790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:51.717199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655019-b58b-41c9-aeaf-b1bef1bab11a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:51.722753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 553/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:55:51 2022] GET /identity/v3/role_assignments?user.id=bc42ac7594354affb6556290bd6da4d8&scope.project.id=c263c3aee4244b15b0301384ef2da632&role.id=dc8bbaa1778e437ab64402e812b88365 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:53.847603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b3d-998d-4e68-b91c-523fb479e777 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:53.848132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b3d-998d-4e68-b91c-523fb479e777 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:53.848132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b3d-998d-4e68-b91c-523fb479e777 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:53.849486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 578/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:53.854580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:53.854956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:53.855115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:53.872820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:53.874011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:53.938254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 554/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:54.209143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6b3d-998d-4e68-b91c-523fb479e777 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:54.263985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:54.306380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6b3d-998d-4e68-b91c-523fb479e777 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:54.338340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:54.338947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:54.339218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:54.339484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:54.340570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:54.341974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ce50-32f7-4e61-ab46-db2864a881d1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:54.343521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 579/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:54.349135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:54.367425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:54.445065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dc497-37db-4435-9e4e-8f5f7729139e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:54.477362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:54.477897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:54.478173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:54.478476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:54.479120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:54.480532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebea86-0d74-4303-8c3e-c628f0623447 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:54.506326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 555/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:55:54 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:56.681924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050fd91-4b25-40c4-b217-41ac0e42fe2e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:56.682477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050fd91-4b25-40c4-b217-41ac0e42fe2e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:56.682477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050fd91-4b25-40c4-b217-41ac0e42fe2e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:56.683844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 580/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:56.689172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:56.689607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:56.689705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:56.707856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:56.709627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:56.768099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:56.773017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 556/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:57.052968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050fd91-4b25-40c4-b217-41ac0e42fe2e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:57.149222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050fd91-4b25-40c4-b217-41ac0e42fe2e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:57.171090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:57.182809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:57.183424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:57.183696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:57.183955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:57.185044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:57.186489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697ffb-aa17-404a-9d1a-e3c6d289b994 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:57.188026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 581/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:55:57.194427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:57.290012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e98f3-9c13-40d1-a534-f6c2c055b3a5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:57.322013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:57.322640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:57.322917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:57.323188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:57.323832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:55:57.325257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed59569-ecd6-44af-bd4f-bed51e2cae06 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:55:57.346354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 557/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:55:57 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:55:59.490062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920d76-57b5-4256-9e94-938101194e94 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:59.490662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920d76-57b5-4256-9e94-938101194e94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:59.490662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920d76-57b5-4256-9e94-938101194e94 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:59.491957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 582/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:55:59.497136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:59.497790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:59.498076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:59.520142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:55:59.521842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:55:59.570283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:55:59.587477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 558/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:55:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:55:59.856499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33920d76-57b5-4256-9e94-938101194e94 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:55:59.953037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33920d76-57b5-4256-9e94-938101194e94 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:55:59.985805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:55:59.986468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:55:59.986748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:55:59.987018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:55:59.997618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:00.002404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:00.003476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:00.004340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 583/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:00.009394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:00.104065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c679d-4cef-408c-ba13-840182d5b16d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:00.135669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:00.136194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:00.136468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:00.136734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:00.137376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:00.137672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:00.139042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:00.147179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 559/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:00.153383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:00.203888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:00.250436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290e22-33fb-4257-8b74-e44cddab991c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:00.283258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:00.283872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:00.284146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:00.284412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] PATH_INFO: `/v3/users/77c9df44f0104c28934daa8e4fe554b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:00.297538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] RBAC: Authorizing `identity:get_user(user_id=77c9df44f0104c28934daa8e4fe554b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:00.298990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:00.300546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 584/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:00 2022] GET /identity/v3/users/77c9df44f0104c28934daa8e4fe554b1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:00.306582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:00.353704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:00.401621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613c74-0b4d-42db-8199-7b2e2fe05071 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:00.433664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:00.434245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:00.434556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:00.434825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:00.499156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:00.500595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:00.545911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:00.595558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 560/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:56:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:56:00.601470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:00.695389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd3ab-a7c8-4abc-b1b6-07094b21fa3e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:00.705351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:00.728020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:00.728629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:00.728901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:00.729166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] PATH_INFO: `/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:00.730243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=74d7bfaede754a7ea5dc2f9d16633ea8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:00.731711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3cccc-d164-4942-8c56-227de56e5fd9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:00.733291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 585/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:00 2022] GET /identity/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:00.739286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:00.835834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c817e5-5ae1-41c8-9a72-02053ac823d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:00.869470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:00.870064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:00.870385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:00.870656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:00.871371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=74d7bfaede754a7ea5dc2f9d16633ea8, user.id=77c9df44f0104c28934daa8e4fe554b1) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:00.871678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:00.873098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf23f5c-6a89-41e4-9347-7a8bbc68fb3e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:00.878288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 561/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:56:00 2022] GET /identity/v3/role_assignments?user.id=77c9df44f0104c28934daa8e4fe554b1&scope.project.id=74d7bfaede754a7ea5dc2f9d16633ea8&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:02.962315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cf45-5718-4b06-bb14-8843ac17b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:02.962866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cf45-5718-4b06-bb14-8843ac17b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:02.962866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cf45-5718-4b06-bb14-8843ac17b5d1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:02.964235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 586/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:02.969359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:02.969760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:02.969903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:02.988343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:02.989537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:02.997219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:03.054590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 562/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:03.320237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cf45-5718-4b06-bb14-8843ac17b5d1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:03.425501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cf45-5718-4b06-bb14-8843ac17b5d1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:03.459983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:03.460609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:03.460912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:03.461235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:03.471112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:03.475832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:03.476884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:03.477859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 587/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:03.483104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:03.579834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510eec-48fc-4db6-8026-c58d83c9e1f6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:03.613002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:03.613608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:03.613886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:03.614156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:03.614846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:03.615151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:03.616514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:03.624761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 563/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:03.631196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:03.670068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:03.740566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150d6e-0135-42fc-a65b-55775e3b71f3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:03.793520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:03.794158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:03.794456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:03.794726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] PATH_INFO: `/v3/users/77c9df44f0104c28934daa8e4fe554b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:03.795840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] RBAC: Authorizing `identity:get_user(user_id=77c9df44f0104c28934daa8e4fe554b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:03.797271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:03.798880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 588/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:03 2022] GET /identity/v3/users/77c9df44f0104c28934daa8e4fe554b1 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:03.805438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:03.809161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:03.901895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76c85c-edf1-4e3d-aa44-00e06d96cf15 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:03.933998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:03.934645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:03.934920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:03.935187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] PATH_INFO: `/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:03.936271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] RBAC: Authorizing `identity:get_project(project_id=74d7bfaede754a7ea5dc2f9d16633ea8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:03.937674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447749e-8c72-4f1c-9dfc-6a040f53f658 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:03.939335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 564/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:03 2022] GET /identity/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:03.945900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:04.044448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daa3a9-38cc-4139-89a9-0d06df8cb4ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:04.051674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:04.078649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:04.079290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:04.079563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:04.079831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] PATH_INFO: `/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8/users/77c9df44f0104c28934daa8e4fe554b1/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:04.081678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d7bfaede754a7ea5dc2f9d16633ea8, user_id=77c9df44f0104c28934daa8e4fe554b1, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:04.083130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356f7a-cc5c-40c1-95bc-15b77d0d2f90 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:04.095473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 589/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:56:03 2022] PUT /identity/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8/users/77c9df44f0104c28934daa8e4fe554b1/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:56:06.229814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3885-5834-410d-8c87-f49ad3a1d7f3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:06.230391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3885-5834-410d-8c87-f49ad3a1d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:06.230391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3885-5834-410d-8c87-f49ad3a1d7f3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:06.231655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 565/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:06.236822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:06.237250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:06.237354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:06.256691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:06.257845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:06.321413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 590/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:56:06.592069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e3885-5834-410d-8c87-f49ad3a1d7f3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:06.660637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:06.691426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e3885-5834-410d-8c87-f49ad3a1d7f3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:06.722425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:06.723034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:06.723306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:06.723572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:06.734017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:06.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:06.740506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:56:06.741712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 566/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:06.746087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:06.834653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:06.840736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499c3c9-9c9f-44aa-bef5-bce2ea7b72e7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:06.874364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:06.874896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:06.875167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:06.875431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:06.876080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:06.876383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:06.877730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:06.885550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 591/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:06.891632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:06.988703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5d3a-61c1-4cad-9efa-02503f940bbd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:07.016263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:07.022043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:07.022694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:07.022972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:07.023241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] PATH_INFO: `/v3/users/77c9df44f0104c28934daa8e4fe554b1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:07.024344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] RBAC: Authorizing `identity:get_user(user_id=77c9df44f0104c28934daa8e4fe554b1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:07.025755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:07.027475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 567/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:06 2022] GET /identity/v3/users/77c9df44f0104c28934daa8e4fe554b1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:07.033145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:07.127986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9a82-75f3-482e-ac0d-e78db87140ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:07.164262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:07.164860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:07.165132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:07.165398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:07.191859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:07.231282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:07.232715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:07.325085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 592/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:56:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:56:07.330993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:07.432281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25a11a-6a15-48ba-9e39-6f8b22aa44de None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:07.468333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:07.468967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:07.469286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:07.469774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] PATH_INFO: `/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:07.471729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] RBAC: Authorizing `identity:get_project(project_id=74d7bfaede754a7ea5dc2f9d16633ea8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:07.473752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e692a-b31e-4761-8242-ba1319437a49 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:07.476706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 568/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:07 2022] GET /identity/v3/projects/74d7bfaede754a7ea5dc2f9d16633ea8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:07.483141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:07.539480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:07.581591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ba4b-261f-4bf1-9865-edbd4fecadfc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:07.614739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:07.615334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:07.615612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:07.615882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:07.616599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=74d7bfaede754a7ea5dc2f9d16633ea8, user.id=77c9df44f0104c28934daa8e4fe554b1) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:07.616904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:07.618352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afcb24-1587-481b-9bf5-e1b0cebd0e67 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:07.623900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 593/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:56:07 2022] GET /identity/v3/role_assignments?user.id=77c9df44f0104c28934daa8e4fe554b1&scope.project.id=74d7bfaede754a7ea5dc2f9d16633ea8&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:09.832091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a654-603c-4834-8f00-7c1587d171db None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:09.832653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a654-603c-4834-8f00-7c1587d171db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:09.832653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a654-603c-4834-8f00-7c1587d171db None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:09.834017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 569/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:09.839273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:09.839654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:09.839814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:09.857959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:09.859162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:09.922877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 594/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:10.188589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a654-603c-4834-8f00-7c1587d171db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:10.254084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:10.288224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a654-603c-4834-8f00-7c1587d171db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:10.320298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:10.320890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:10.321170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:10.321439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:10.385481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:10.386939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:10.447771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:10.480570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 570/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:56:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:56:10.486381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:10.535098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:10.579886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef3208-6235-4483-844e-cab4a3500a05 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:10.611870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:10.612475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:10.612749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:10.613012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:10.619342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:10.620763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3ca51694-bd87-442e-a8c0-5c843e2c01ff None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:10.633220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:10.634431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 14:56:10.635536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:10.638419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 595/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:56:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:10.640162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:10.735693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2065efc-3feb-41b7-b211-3b5ba5ac614f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:10.767906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:10.768498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:10.768774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:10.769045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:10.769670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:10.769971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:10.771958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d1cb-0fc6-49fd-b2bf-ff41cfe4bf00 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:10.778766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 571/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 14:56:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:12.930605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a849-5318-4b63-af6f-06e0aa447cd1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:12.931134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a849-5318-4b63-af6f-06e0aa447cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:12.931134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a849-5318-4b63-af6f-06e0aa447cd1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:12.932472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 596/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:12.937668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ba73-c50f-4ccb-8b5a-29298c47f7b4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:12.938031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ba73-c50f-4ccb-8b5a-29298c47f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:12.938210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ba73-c50f-4ccb-8b5a-29298c47f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:12.956389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0098ba73-c50f-4ccb-8b5a-29298c47f7b4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:12.957564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0098ba73-c50f-4ccb-8b5a-29298c47f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:12.983042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:13.023478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 572/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:13.288811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a849-5318-4b63-af6f-06e0aa447cd1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:13.385400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a849-5318-4b63-af6f-06e0aa447cd1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:13.398318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:13.419945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:13.420538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:13.420812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:13.421078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:13.421736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:13.423116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912423b5-d55f-4821-9e4f-7997cd97d221 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:13.438081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 597/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sun Sep 11 14:56:13 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:56:15.585531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547082-ec7a-4e6e-bec9-cd7837bd6080 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:15.586088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547082-ec7a-4e6e-bec9-cd7837bd6080 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:15.586088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547082-ec7a-4e6e-bec9-cd7837bd6080 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:15.587420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 573/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:15.592770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:15.593159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:15.593314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:15.611483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:15.612646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:15.675919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 598/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:15.945094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c547082-ec7a-4e6e-bec9-cd7837bd6080 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:16.041377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c547082-ec7a-4e6e-bec9-cd7837bd6080 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:16.074221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:16.074855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:16.075147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:16.075398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] PATH_INFO: `/v3/domains/06aca99adc6c4aeca2de8fe4d930af09` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:16.085793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=06aca99adc6c4aeca2de8fe4d930af09)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:16.087233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f8e31-ddb3-49f4-98cc-c667b92c9ba4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:16.088774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 574/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 14:56:15 2022] GET /identity/v3/domains/06aca99adc6c4aeca2de8fe4d930af09 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:16.094566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:16.189202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870e064-00e8-4adc-9088-4593cd3df8cc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:16.190674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:16.223791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:16.224338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:16.224616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:16.224885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:16.225518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:16.226963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacf790-d2c4-492f-9735-a452b2af7c85 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:16.251872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 599/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:56:16 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:56:18.435490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb29c9-58c3-4a57-bd48-ad54b881c849 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:18.436000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb29c9-58c3-4a57-bd48-ad54b881c849 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:18.436113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb29c9-58c3-4a57-bd48-ad54b881c849 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:18.437365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 575/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:18.442522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:18.442931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:18.443065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:18.461195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:18.462388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:18.526246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 600/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:18.794092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb29c9-58c3-4a57-bd48-ad54b881c849 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:18.818654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:18.892933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb29c9-58c3-4a57-bd48-ad54b881c849 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:18.924870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:18.925483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:18.925761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:18.926031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] PATH_INFO: `/v3/domains/06aca99adc6c4aeca2de8fe4d930af09` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:18.927513 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=06aca99adc6c4aeca2de8fe4d930af09)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:18.928927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b3690-58ae-411d-bf7f-acc33b7c84d0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:18.930487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 576/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 14:56:18 2022] GET /identity/v3/domains/06aca99adc6c4aeca2de8fe4d930af09 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:18.936002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:19.015728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:19.032392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfddf03-f408-486b-830a-3ef4ec8d0344 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:19.065928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:19.066487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:19.066762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:19.067538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:19.068188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:19.069611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9c78-64d4-4d4f-8a1e-221b977063e5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:19.092145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 601/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:56:18 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:56:21.235841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfb5-914c-4ae1-87f3-dd7a30984da5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:21.236371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfb5-914c-4ae1-87f3-dd7a30984da5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:21.236371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bfb5-914c-4ae1-87f3-dd7a30984da5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:21.237644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 577/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:21.243399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:21.243821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:21.243946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:21.261701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:21.262909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:21.327058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 602/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:21.593614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bfb5-914c-4ae1-87f3-dd7a30984da5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:21.681340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:21.692233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bfb5-914c-4ae1-87f3-dd7a30984da5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:21.724682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:21.725291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:21.725566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:21.725837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:21.735878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:21.740630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:21.741692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:56:21.742774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 578/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:21.747736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:21.814311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:21.845642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a304f8-34b0-455d-9131-d51b6c5a916b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:21.877642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:21.878238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:21.878547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:21.878820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:21.879991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:21.880294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:21.881655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:21.889371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 603/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:21.896012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:21.992159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a768d-2ca3-4146-9c74-2833bdd38bfc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:22.025046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:22.025665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:22.025943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:22.026215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] PATH_INFO: `/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:22.038796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] RBAC: Authorizing `identity:get_user(user_id=e61fd171f30b4832a9f0effc3d5e7ea2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:22.040223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:22.041794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 579/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:21 2022] GET /identity/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:22.047633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:22.143136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec293b4-bda0-449b-919d-f6c8143c6c7a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:22.170759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:22.175823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:22.177165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:22.177436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:22.177697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:22.246191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:22.248371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:22.344175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 604/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:56:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:56:22.350409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:22.360789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:22.444622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00a9e-205f-4d2f-b9a4-5954680e0c60 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:22.476664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:22.477271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:22.477543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:22.477808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] PATH_INFO: `/v3/projects/0618917a8a8c47d18a43861c9cdcd186` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:22.478993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] RBAC: Authorizing `identity:get_project(project_id=0618917a8a8c47d18a43861c9cdcd186)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:22.480429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5480bb-f8fc-4b54-b6dc-48f5c53d75eb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:22.482063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 580/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:22 2022] GET /identity/v3/projects/0618917a8a8c47d18a43861c9cdcd186 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:22.488268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:22.524953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:22.605183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777e2b-fba5-4439-8efe-be99c253d631 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:22.637940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:22.638568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:22.638846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:22.639114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:22.639824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=0618917a8a8c47d18a43861c9cdcd186, user.id=e61fd171f30b4832a9f0effc3d5e7ea2) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:22.640130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:22.641552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3812-5565-4ac1-9922-ef511ab8b766 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:22.646706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 605/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:56:22 2022] GET /identity/v3/role_assignments?user.id=e61fd171f30b4832a9f0effc3d5e7ea2&scope.project.id=0618917a8a8c47d18a43861c9cdcd186&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:24.748979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870711-69d0-4f27-a368-366ab39e3e44 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:24.749509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870711-69d0-4f27-a368-366ab39e3e44 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:24.749600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870711-69d0-4f27-a368-366ab39e3e44 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:24.750957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 581/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:24.756796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:24.757189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:24.757331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:24.774967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:24.776139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:24.839812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 606/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:25.106252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870711-69d0-4f27-a368-366ab39e3e44 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:25.185591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:25.209739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870711-69d0-4f27-a368-366ab39e3e44 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:25.243236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:25.243849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:25.244126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:25.244394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:25.253959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:25.258717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:25.259775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:56:25.260704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 582/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:25.265849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:25.292262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:25.362633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d748bf-b679-4e25-9526-9fdbe60a6d1a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:25.394465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:25.395571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:25.395844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:25.396107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:25.396756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:25.397053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:25.398427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:25.406166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 607/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:25.412511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:25.516405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151a5c-33d1-4870-8eb6-966f9a623b31 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:25.548962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:25.549583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:25.549858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:25.550126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] PATH_INFO: `/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:25.551288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] RBAC: Authorizing `identity:get_user(user_id=e61fd171f30b4832a9f0effc3d5e7ea2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:25.552968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:25.554560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 583/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:25 2022] GET /identity/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:25.560491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:25.645764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:25.657852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbf84-48b8-442a-b241-5ec1d220f360 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:25.689511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:25.690124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:25.690429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:25.690699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] PATH_INFO: `/v3/projects/0618917a8a8c47d18a43861c9cdcd186` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:25.692322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] RBAC: Authorizing `identity:get_project(project_id=0618917a8a8c47d18a43861c9cdcd186)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:25.693738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca1f14-f2fc-4024-97ec-745f7baaa11f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:25.695358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 608/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:25 2022] GET /identity/v3/projects/0618917a8a8c47d18a43861c9cdcd186 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:25.701131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:25.704888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:25.796227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881ba2-eed0-4311-929d-8741d0d7cff9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:25.828241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:25.828872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:25.829144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:25.829408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] PATH_INFO: `/v3/projects/0618917a8a8c47d18a43861c9cdcd186/users/e61fd171f30b4832a9f0effc3d5e7ea2/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:25.831277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] RBAC: Authorizing `identity:create_grant(project_id=0618917a8a8c47d18a43861c9cdcd186, user_id=e61fd171f30b4832a9f0effc3d5e7ea2, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:25.832724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802bfc-1cf4-4d90-b2da-9a1eca8f6258 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:25.844666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 584/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:56:25 2022] PUT /identity/v3/projects/0618917a8a8c47d18a43861c9cdcd186/users/e61fd171f30b4832a9f0effc3d5e7ea2/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:56:27.962986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4f37c-f00b-4357-b021-018fa596a084 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:27.963580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4f37c-f00b-4357-b021-018fa596a084 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:27.963580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4f37c-f00b-4357-b021-018fa596a084 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:27.964873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 609/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:56:27.970042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:27.970477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:27.970675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:27.988674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:56:27.989840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:56:28.045806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:28.055263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 585/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:56:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:56:28.324025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4f37c-f00b-4357-b021-018fa596a084 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:28.426501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4f37c-f00b-4357-b021-018fa596a084 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:28.458788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:28.459395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:28.459669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:28.459938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:28.470458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:56:28.475691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:56:28.476775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:56:28.477810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 610/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:56:28.483016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:28.576676 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e109b7-a006-43da-b529-efb2d3d719d7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:28.608654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:28.609235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:28.609508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:28.609775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:28.610449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:28.610750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:28.612091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:28.619739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 586/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:28.625431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:28.643601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:28.721939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccf473-e74f-44f1-8036-efc9ffc8d4df None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:28.753360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:28.753962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:28.754780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:28.755046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] PATH_INFO: `/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:28.756135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] RBAC: Authorizing `identity:get_user(user_id=e61fd171f30b4832a9f0effc3d5e7ea2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:28.757538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:28.759097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 611/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 14:56:28 2022] GET /identity/v3/users/e61fd171f30b4832a9f0effc3d5e7ea2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:28.764731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:28.818902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:28.861086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30342b47-329d-4a88-aeb0-fa6dcc9b74f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:28.892626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:28.893208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:28.893482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:28.893746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:28.957901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:28.959353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:29.011024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:29.053944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 587/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:56:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:56:29.059823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:29.139188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:29.155147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dca7c7-e850-44b6-a13d-3f660d684b42 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:29.187670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:29.188343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:29.188614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:29.188878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] PATH_INFO: `/v3/projects/0618917a8a8c47d18a43861c9cdcd186` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:29.189962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] RBAC: Authorizing `identity:get_project(project_id=0618917a8a8c47d18a43861c9cdcd186)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:29.191415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648b55-601c-4ec7-b415-98b96bae508e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:29.193012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 612/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 14:56:29 2022] GET /identity/v3/projects/0618917a8a8c47d18a43861c9cdcd186 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:29.200278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:56:29.298257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354da4ea-e744-4dbf-9f48-3c0b6dcd87a0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:56:29.331062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:56:29.331818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:56:29.332101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:56:29.332939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:56:29.333651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=0618917a8a8c47d18a43861c9cdcd186, user.id=e61fd171f30b4832a9f0effc3d5e7ea2) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:56:29.333960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:56:29.335411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a473-f004-46b6-944a-b9884cf23391 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:56:29.341021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 588/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:56:29 2022] GET /identity/v3/role_assignments?user.id=e61fd171f30b4832a9f0effc3d5e7ea2&scope.project.id=0618917a8a8c47d18a43861c9cdcd186&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:56:39.183745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=24 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:56:39.338518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:25.351998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b294f5-d63e-4d52-bba9-7b6301b37eb5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:25.352595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b294f5-d63e-4d52-bba9-7b6301b37eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:25.352595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b294f5-d63e-4d52-bba9-7b6301b37eb5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:25.353875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 613/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:25.359606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:25.360222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:25.360222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:25.383694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:25.384978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:25.478360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 589/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:25.773071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b294f5-d63e-4d52-bba9-7b6301b37eb5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:25.922077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b294f5-d63e-4d52-bba9-7b6301b37eb5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:25.964444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:25.965434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:25.965933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:25.966454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:25.980600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:25.982294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:25.998050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:25.999687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:26.000667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:26.000667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:26.000667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:26.000667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 614/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:26.005996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:26.132014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768b8a-c368-47bf-bf81-9cae34c12038 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:26.171172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:26.181237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:26.181901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:26.182489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:26.182827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:26.183510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:26.183951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:26.185698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34441aef-c11b-4905-a1a0-3574c44905b8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:26.200266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 590/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:26.207065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:26.278992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:26.343037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa71e-7eb0-489a-b514-84433f505f2a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:26.384117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:26.384739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:26.384940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:26.385231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:26.385908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:26.387523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc11f28-fc53-471a-aeb9-8a3336e452f2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:26.421369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 615/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 14:57:26 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:57:28.970938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d719-5628-49ab-8700-b2cf46787b6f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:28.971570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d719-5628-49ab-8700-b2cf46787b6f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:28.971570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d719-5628-49ab-8700-b2cf46787b6f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:28.972943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 591/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:28.983387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:28.983387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:28.983387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:29.001839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:29.003074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:29.077719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 616/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:29.344426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42d719-5628-49ab-8700-b2cf46787b6f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:29.465454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42d719-5628-49ab-8700-b2cf46787b6f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:29.506948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:29.507685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:29.508014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:29.508369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:29.523009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:29.527896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:29.528842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:29.529728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 592/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:29.535245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:29.588636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:29.661616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093260a-0c3f-4106-ad4e-b45fdba5618b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:29.698755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:29.699365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:29.699642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:29.699912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:29.700586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:29.700889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:29.702280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:29.711560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 617/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:29.717413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:29.774691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:29.833363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f3d11-f90f-412f-af25-c3cec9dc9791 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:29.875006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:29.875678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:29.875922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:29.876212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:29.887566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:29.889010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:29.904424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:29.906159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:29.907402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:29.907402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:29.907402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:29.910518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 593/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:29.913432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:30.024818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:30.027982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368dfed-bb90-44e5-a374-6608ba464abd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:30.070283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:30.070890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:30.071146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:30.071468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:30.072057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:30.072353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:30.073714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:30.088120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 618/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:30.095166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:30.214594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e226cc-e2c0-457b-a921-bec5887bb77b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:30.216017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:30.249209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:30.249763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:30.250127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:30.250453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:30.258619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:30.260054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:30.271891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:30.272896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:30.273844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:30.277852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 594/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:30.278785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:30.388622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc0835-0274-4849-b2c4-e95a8a4d2f32 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:30.428327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:30.429185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:30.429453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:30.429715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:30.430465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:30.430769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:30.432193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:30.450584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 619/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:30.456809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:30.594030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866740-68b6-4b99-9bfb-2ce54206158b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:30.632428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:30.633099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:30.633502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:30.633848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:30.668521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:30.716407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:30.717863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:30.850857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 595/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:57:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:57:30.856432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:30.891590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:30.979748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330a1e-628d-408f-af56-5c9c79ac508a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:31.017164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:31.018437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:31.018713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:31.018980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:31.028895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:31.030717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:31.046331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:31.047717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:31.048831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:31.048831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:31.048831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:31.048831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 620/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:31.053679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:31.119080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:31.162004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc16b7-aab5-426b-b71d-25a0b0adbc81 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:31.205595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:31.206238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:31.206581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:31.206849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:31.207545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:31.207960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:31.209680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:31.221932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 596/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:31.227814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:31.307353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:31.344428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626a07-1413-433e-bd33-4f2f5dcba5a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:31.391178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:31.392019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:31.392539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:31.393046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:31.403118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:31.404699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:31.418461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:31.419570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:31.420828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 621/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:31.426843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:31.551937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1127dd8-8cc4-4155-9fe1-5c2683ed371d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:31.576043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:31.589904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:31.590709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:31.591149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:31.591411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:31.592198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:31.592577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:31.594247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dfec7-e942-4108-8726-b071c137f1ae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:31.607944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 597/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:31.618898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:31.755349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f69c8-ddc6-409e-8b55-4da3031e0e54 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:31.788410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:31.794752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:31.795352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:31.795629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:31.795896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:31.796613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=c7b33447fc1e41e1bf083519b827cdb9) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:31.796917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:31.798390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908390-3f9f-4c35-9699-95bdf029b844 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:31.804959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 622/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:57:31 2022] GET /identity/v3/role_assignments?user.id=c7b33447fc1e41e1bf083519b827cdb9&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:34.126003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e76a-eb84-41c7-812e-5438acc2be49 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:34.127110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e76a-eb84-41c7-812e-5438acc2be49 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:34.127110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e76a-eb84-41c7-812e-5438acc2be49 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:34.128485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 598/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:34.133798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:34.134320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:34.134412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:34.154664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:34.155862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:34.231036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 623/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:34.503680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e76a-eb84-41c7-812e-5438acc2be49 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:34.615991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e76a-eb84-41c7-812e-5438acc2be49 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:34.652371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:34.652990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:34.653277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:34.653533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:34.664458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:34.669180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:34.670421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:34.671423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 599/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:57:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:57:34.676835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:34.779855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0339c-b55a-48f3-919d-e5de350c4030 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:34.805863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:34.818577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:34.819352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:34.819678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:34.820009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:34.820743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:34.821091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:34.822689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:34.830995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 624/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:57:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:34.837523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:34.892996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:34.956919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2859f7b-dc4f-4063-a4ca-c483c5bb99f8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:34.995900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:34.996550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:34.996808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:34.997077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.007342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.008988 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:35.026397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:35.027559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:35.028567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:35.028567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:35.028567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:35.028567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 600/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 14:57:35.035242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.160205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb547cf-40c3-4ab5-aa09-03469f95b3b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:35.202207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:35.202892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:35.203171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:35.203450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.204148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:35.204450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.206466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.219153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 625/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:35.225310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.335494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:35.343392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9294-4c90-4e72-aaa3-30f5410ce6df None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:35.378990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:35.379622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:35.379940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:35.380172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.387714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.389164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:35.400646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:35.401791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:35.402914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 601/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:35.407588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.458343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:35.519636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427e440-df5b-4801-a6d9-544311520f99 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:35.562033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:35.562671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:35.562948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:35.563217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.564457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:35.564754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.566488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.584613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 626/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:35.590620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.707125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff19b-dc15-459b-bd4f-59158affb440 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:35.743302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:35.744010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:35.744320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:35.744624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.757732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.759393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:35.774393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:35.775644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:35.776716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:35.776716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:35.776716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:35.776716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 602/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:35.781417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.888750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46926421-3b61-4f67-be64-78958267cf2b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:35.891170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:35.931793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:35.932546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:35.932899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:35.933261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:35.934158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:35.934623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:35.936352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:35.951758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 627/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:35.957780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:35.968185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:36.076832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac569-6158-417e-ac10-14d4eb089127 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:36.116996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:36.117631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:36.117913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:36.118179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:36.124938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:36.126919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:36.137919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:36.139149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:36.140047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 603/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:36.145909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:36.256388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6380-0e35-4aaa-b3d5-4de6ef1c4bd3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:36.295529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:36.296182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:36.296472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:36.296780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:36.297515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:36.297838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:36.300015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895ec09-1842-494f-9666-32b881bdbe54 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:36.312730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 628/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:36.318846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:36.390654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:36.427498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb00b8-c8df-4207-89f6-6beab72a488a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:36.464722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:36.465504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:36.465795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:36.466136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/c7b33447fc1e41e1bf083519b827cdb9/roles/3940cfd9835e4cf8be9fe5babbef7447` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:36.482009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=c7b33447fc1e41e1bf083519b827cdb9, role_id=3940cfd9835e4cf8be9fe5babbef7447)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:36.483511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d7773-4a18-4ec8-b16c-5e5f4a9fc220 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:36.497215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 604/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:57:36 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/c7b33447fc1e41e1bf083519b827cdb9/roles/3940cfd9835e4cf8be9fe5babbef7447 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:57:38.696763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61cb4-1b41-4214-9bd9-ebac3228f938 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:38.697424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61cb4-1b41-4214-9bd9-ebac3228f938 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:38.697612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61cb4-1b41-4214-9bd9-ebac3228f938 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:38.699285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 629/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 14:57:38.704945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:38.705383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:38.705480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:38.725564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:38.726785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:38.816286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 605/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:39.135314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61cb4-1b41-4214-9bd9-ebac3228f938 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:39.167574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:39.262307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61cb4-1b41-4214-9bd9-ebac3228f938 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:39.303736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:39.304356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:39.304643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:39.304974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:39.315312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:39.320155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:39.326403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:39.327538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 630/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 14:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:39.328449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:39.380931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:39.444585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad8262-8d0a-46e0-b308-e607437fb99e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:39.480638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:39.481249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:39.481536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:39.481779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:39.482468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:39.482767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:39.484129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:39.492918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 606/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 14:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:39.498844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:39.587756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:39.605759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd532-f86d-4250-bccb-6b07cfa53d83 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:39.643047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:39.643687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:39.643946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:39.644213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:39.654774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:39.656243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:39.672286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:39.674088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:39.675201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:39.675201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:39.675201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:39.676958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 631/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:39.683146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:39.793098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61dd6-0c6c-4347-9c5d-1030d58f209e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:39.804407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:39.838368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:39.839205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:39.839586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:39.840021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:39.840926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:39.841384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:39.843854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:39.857829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 607/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:39.865484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:39.987860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cc63-c9a0-4b53-b392-bc209540770b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:40.026251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:40.027056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:40.027328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:40.027651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:40.030523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:40.037273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:40.039048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:40.051354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:40.052760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:40.054059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 632/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:40.059093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:40.182824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411fdd-ac16-468b-a500-f8c46d9dbe63 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:40.224818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:40.225421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:40.225693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:40.225962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:40.226706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:40.227007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:40.228427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:40.248929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 608/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:40.254969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:40.365546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c9e0-e680-47a9-8da6-ad8aaeb3c295 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:40.401394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:40.402178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:40.402686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:40.402957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:40.475568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:40.484327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:40.485876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:40.594374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 633/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:57:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:57:40.600201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:40.629685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:40.714879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0138-7820-4851-bae4-6a4ef6c3f178 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:40.754406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:40.754967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:40.755249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:40.755542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:40.768358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:40.770083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:40.786622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:40.787738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:40.788793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:40.788793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:40.788793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:40.788793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 609/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:40.795535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:40.903269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:40.911155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c423-bf63-4eac-bb20-f11bd9afc8fa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:40.952732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:40.953344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:40.953607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:40.953914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:40.954605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:40.954915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:40.956455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:40.973792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 634/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:40.975103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:41.068596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:41.091458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435191d3-4c43-4035-a5ba-99ed2a151e4f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:41.128848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:41.129496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:41.129777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:41.130049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:41.137372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:41.138945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:41.152018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:41.153248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:41.154391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:41.158191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 610/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:41.159309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:41.279152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a5a9-1480-4c9c-aa14-057e4ed4a21a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:41.318087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:41.318849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:41.319098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:41.319399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:41.320152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:41.320485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:41.322449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b50f-b1dd-4dd1-b510-0d6548f7c308 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:41.339580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 635/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:41.345689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:41.457614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cc97-2b71-4b21-a3a5-ee6270c6e9a8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:41.497902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:41.498605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:41.498893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:41.499176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:41.499910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] RBAC: Adding query filter params (role.id=3940cfd9835e4cf8be9fe5babbef7447, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=c7b33447fc1e41e1bf083519b827cdb9) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:41.500278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:41.501885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49db76-53fd-46f7-96c2-cdcab3c1b55d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:41.508606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 611/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:57:41 2022] GET /identity/v3/role_assignments?user.id=c7b33447fc1e41e1bf083519b827cdb9&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=3940cfd9835e4cf8be9fe5babbef7447 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:43.759640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e0a-9c54-46fa-8fec-df2cbf49c96b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:43.760232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e0a-9c54-46fa-8fec-df2cbf49c96b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:43.760232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e0a-9c54-46fa-8fec-df2cbf49c96b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:43.761499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 636/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:43.767783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:43.768283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:43.768507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:43.776829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:43.791328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:43.792686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:43.868114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 612/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:44.138536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7e0a-9c54-46fa-8fec-df2cbf49c96b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:44.159280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:44.253839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7e0a-9c54-46fa-8fec-df2cbf49c96b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:44.292151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:44.292804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:44.293083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:44.293350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:44.303422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:44.308194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:44.309313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:44.310179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 637/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:44.316339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:44.432799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0812-6f3a-49d6-9055-98f111e33309 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:44.471943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:44.480747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:44.481348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:44.481620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:44.481884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:44.482577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:44.482877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:44.484225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:44.494309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 613/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:57:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:44.500721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:44.586664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:44.612764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b5b4b-c704-48e5-919a-1bb360fbd8e4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:44.650963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:44.651612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:44.651895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:44.652165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:44.663518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:44.665090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:44.681012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:44.682128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:44.683375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:44.683375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:44.683375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:44.687948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:44.688377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 638/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:44.791475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f899c4-7b36-4cee-83e0-e82acb674eb0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:44.827953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:44.828587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:44.828873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:44.829192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:44.829833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:44.830140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:44.831678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:44.844591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 614/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:44.850401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:44.968485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304a1b3-80ce-4693-8b3a-7c216eeb8315 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:45.001785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:45.012395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:45.013467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:45.013917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:45.014340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:45.024756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:45.026596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:45.042086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:45.043274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:45.044589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 639/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:45.049187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:45.116230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:45.163272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cf647-f126-439b-8aad-ddebec5db4b8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:45.200140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:45.200815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:45.201118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:45.201416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:45.202185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:45.202529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:45.204325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:45.230571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 615/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:45.231701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:45.336835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb00e-7b65-4757-9fc1-d002226f296b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:45.371536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:45.372158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:45.372448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:45.372708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:45.433456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:45.449335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:45.450867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:45.559681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 640/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:57:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 14:57:45.566332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:45.666413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6d79-8286-48e8-856e-f4bb7efca480 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:45.680455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:45.701093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:45.701716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:45.701986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:45.702251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:45.712732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:45.714182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:45.729059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:45.730202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:45.731365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:45.731365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:45.731365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:45.731365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 616/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:45.736895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:45.823717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:45.836274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b354b-f38a-44fa-82a7-1e42ca42eb3c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:45.868028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:45.868613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:45.868888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:45.869156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:45.869786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:45.870089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:45.871485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:45.882684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 641/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:45.888282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:45.986219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0e3a-7691-435e-ab39-515808c81566 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:46.019216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:46.019827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:46.020098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:46.020363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:46.026677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:46.028125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:46.038902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:46.039961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:46.041082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 617/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:46.045779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:46.142387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07c760-7b52-4148-afb8-42de76703222 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:46.174356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:46.174950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:46.175253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:46.175519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:46.176191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:46.176748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:46.178159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581b300-6be9-43a3-86af-ba5cc0d2ce13 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:46.189664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 642/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:46.195811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:46.221431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:46.292169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10d7-52d7-4440-9e8d-a8494838c281 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:46.323649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:46.324227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:46.324499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:46.324765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:46.325463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=c7b33447fc1e41e1bf083519b827cdb9) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:46.325764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:46.327191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d28bb-2cbc-4172-acb8-8fdcf9fbddff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:46.332848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 618/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:57:46 2022] GET /identity/v3/role_assignments?user.id=c7b33447fc1e41e1bf083519b827cdb9&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:48.429276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f69b8a-3d57-4f03-8d24-710994fd80d0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:48.429794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f69b8a-3d57-4f03-8d24-710994fd80d0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:48.429794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f69b8a-3d57-4f03-8d24-710994fd80d0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:48.431204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 643/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:48.436189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8f63-849c-4238-9577-93eac9167425 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:48.436601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8f63-849c-4238-9577-93eac9167425 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:48.436733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8f63-849c-4238-9577-93eac9167425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:48.454998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-808e8f63-849c-4238-9577-93eac9167425 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:48.456172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-808e8f63-849c-4238-9577-93eac9167425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:48.537550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 619/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:48.810291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f69b8a-3d57-4f03-8d24-710994fd80d0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:48.821451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:48.909695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f69b8a-3d57-4f03-8d24-710994fd80d0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:48.941835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:48.942475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:48.942748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:48.943011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:48.952550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:48.957805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:48.958940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:48.960066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 644/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:48.967080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8f63-849c-4238-9577-93eac9167425 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:48.984822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:49.062210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8f63-849c-4238-9577-93eac9167425 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.095948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.096536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.096813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.097080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.097729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:49.098028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.099404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.107149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 620/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:49.113009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:49.178752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:49.211374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460a03-61ef-4c08-9fbb-91796402ecd4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.244489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.245106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.245381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.245650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.255829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.257266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:49.271176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:49.272269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:49.273345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:49.273345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:49.273345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:49.273345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 645/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:49.278024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:49.356439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:49.375792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d4de-7e04-4445-94ea-cbcddaf5a876 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.409149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.409761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.410059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.410365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.411005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:49.411304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.412655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.424507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 621/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:49.430287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:49.535923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c7a72-9668-49e7-80d7-3441cb4ff50f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.556006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:49.570180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.570828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.571105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.571375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.578560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.580453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:49.591258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:49.592352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:49.593461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 646/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:49.598711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:49.694564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbede3c-a5a4-4c6f-9f98-7b14f697dec2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.726812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.727398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.727674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.727940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.728644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:49.728944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.730371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.739172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:49.747680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 622/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:49.753466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:49.849495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43bb92-19ca-4b39-abe2-f7c1bfeb4512 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:49.881878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:49.882508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:49.882786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:49.883052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:49.893107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:49.894559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:49.908714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:49.909787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:49.910927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:49.910927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:49.910927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:49.910927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 647/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:49.915444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:50.011652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d496fc-1892-433c-879a-4d348cf0ed6d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:50.046802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:50.047399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:50.047682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:50.047949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:50.048580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:50.048874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:50.050216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:50.061271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 623/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:50.066988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:50.098299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:50.164415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2d296-64a7-4e25-a882-0b50f52e3ec7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:50.196208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:50.196812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:50.197084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:50.197346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:50.203643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:50.205598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:50.216414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:50.217275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:50.218354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 648/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:50.223832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:50.279747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:50.321588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a972792-5f66-4ad4-a08c-e6dbd2056122 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:50.353875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:50.354491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:50.354770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:50.355040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:50.355711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:50.356013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:50.357420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd1c2-d2a5-4df9-95b1-cc096bdc4ddf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:50.369427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 624/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:50.375184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:50.463002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:50.472352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36c11-69a1-4ee4-923b-db11218f532a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:50.508288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:50.509251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:50.509530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:50.509858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] PATH_INFO: `/v3/projects/424d0a4464c64d5995512badce1e3346/users/c7b33447fc1e41e1bf083519b827cdb9/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:50.512555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] RBAC: Authorizing `identity:create_grant(project_id=424d0a4464c64d5995512badce1e3346, user_id=c7b33447fc1e41e1bf083519b827cdb9, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:50.514390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4edd5e-854f-45d1-b888-407fa08d4099 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:50.528980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 649/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 14:57:50 2022] PUT /identity/v3/projects/424d0a4464c64d5995512badce1e3346/users/c7b33447fc1e41e1bf083519b827cdb9/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 14:57:52.628140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153238-19fb-4cb4-8d7b-fbb199d21db4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:52.628666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153238-19fb-4cb4-8d7b-fbb199d21db4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:52.628666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153238-19fb-4cb4-8d7b-fbb199d21db4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:52.630010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 625/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:52.635061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:52.635495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:52.635588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:52.653848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:52.655058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:52.718863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 650/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:57:52.982112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf153238-19fb-4cb4-8d7b-fbb199d21db4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.081861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf153238-19fb-4cb4-8d7b-fbb199d21db4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.098187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:53.115219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.115831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.116108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.116376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.126565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 14:57:53.131256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:53.132320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:53.133153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 626/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 14:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:53.139264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.216272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:53.235204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce40e9-b014-4482-9b9b-93b922293002 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.267827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.268431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.268707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.268977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.269641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:53.269948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:53.271371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:53.279388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 651/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:53.285996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.383620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e360c8c-9f08-40b2-bf92-6ac26af8aa6e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.416918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.417531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.417808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.418075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.428036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:53.429459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:53.443877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:53.444996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:53.445970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:53.445970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:53.445970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:53.445970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 627/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:53.450692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.563407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1a513-d431-41b1-b7ca-ae039043347f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.600174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.600776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.601048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.601320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.602008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:53.602321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:53.603738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:53.615958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 652/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:53.621651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.651429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:53.720543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c866bfa-9138-46a1-92f7-7505f9649020 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.755007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.755620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.755898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.756171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.763274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:53.764697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 14:57:53.775998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:53.777094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:53.778105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 628/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:53.783374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:53.787103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:53.878850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b626c-459a-425a-b2a3-1f6c54926fec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:53.914859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:53.915465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:53.915740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:53.916007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:53.916723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:53.917023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:53.918595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:53.938553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 653/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:53.944511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.032829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:54.042634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957e52-1a77-4d93-9a4b-b66a39efa6c9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:54.078517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:54.079672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:54.079951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:54.080222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:54.144804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:54.146240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:54.239308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:54.250148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 629/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 14:57:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 14:57:54.256569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.315611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:54.352857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8886-87e2-4291-817b-1a623fd8ab7b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:54.385727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:54.386374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:54.386651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:54.386917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:54.397164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:54.398576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 14:57:54.412948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:54.413903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 14:57:54.414955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 14:57:54.414955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 14:57:54.414955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:54.414955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 654/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 14:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:54.419694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.516628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38195b40-5c4d-487e-9eba-dfb040a6006e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:54.549001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:54.549588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:54.549860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:54.550148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:54.550804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:54.551100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:54.552695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:54.563330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 630/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 14:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:54.568871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.665553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2ffd-73be-450c-ab79-63bc36d27d85 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:54.678744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:54.698563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:54.699171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:54.699445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:54.699713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:54.706619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:54.708039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 14:57:54.718797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:54.720405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 11 14:57:54.721357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 655/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 14:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:54.726108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.773778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:54.822291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad89-f725-41ca-9558-87682fce6356 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:54.854209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:54.854832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:54.855107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:54.855373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:54.856053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:54.856354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:54.857793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a19171-2215-49d4-9400-57a3ae4fce1a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:54.869324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 631/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 14:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 14:57:54.875202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:54.971426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba85d-de46-473c-aa4f-1c7296dd398e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:55.003714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:55.004331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:55.004607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:55.004875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:55.005583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] RBAC: Adding query filter params (role.id=06cb7c5bf25a4456a6d24ca3b67b6350, scope.project.id=424d0a4464c64d5995512badce1e3346, user.id=c7b33447fc1e41e1bf083519b827cdb9) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:55.005888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:55.007341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af183b-1398-42f5-a72e-99310e20c528 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:55.012915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 656/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 14:57:54 2022] GET /identity/v3/role_assignments?user.id=c7b33447fc1e41e1bf083519b827cdb9&scope.project.id=424d0a4464c64d5995512badce1e3346&role.id=06cb7c5bf25a4456a6d24ca3b67b6350 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:57.185394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350145ff-ad8e-416c-a6d5-c455074509cd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:57.185916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350145ff-ad8e-416c-a6d5-c455074509cd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:57.185916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350145ff-ad8e-416c-a6d5-c455074509cd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:57.187304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 632/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:57:57.192909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:57.193277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:57.193456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:57.211751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:57:57.212936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:57:57.240985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:57.277574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 657/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:57:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:57:57.540217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350145ff-ad8e-416c-a6d5-c455074509cd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:57.643740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350145ff-ad8e-416c-a6d5-c455074509cd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:57.653818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:57:57.677137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:57.677748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:57.678028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:57.678322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:57.678892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:57.680240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:57:57.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:57:57.690516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:57:57.691353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 633/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:57:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:57:57.696315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:57.789474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a7a8-6450-412d-9d50-824864b87659 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:57.821851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:57.822410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:57.822683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:57.822949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:57.823560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:57.823855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:57.825295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57a9e4-3dba-470e-a223-1d504f0a07e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:57.829965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 658/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 14:57:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:57:57.835588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:57:57.932564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9988f3a-ed3e-4798-8af5-1ce68bb0998c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:57:57.964199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:57:57.964798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:57:57.965071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:57:57.965341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:57:57.965958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:57:57.966261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:57:57.967631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2927a5-e5e6-4c6c-8ae2-ebbc97392e7b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:57:57.974013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 634/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 14:57:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:58:00.102304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410f07-119f-4cf0-b26d-b29bf99b11a9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:00.102851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410f07-119f-4cf0-b26d-b29bf99b11a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:00.102851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410f07-119f-4cf0-b26d-b29bf99b11a9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:00.104199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 659/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:58:00.109385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbebf-6918-4b05-a99a-7391aa44926a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:00.109807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbebf-6918-4b05-a99a-7391aa44926a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:00.109914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbebf-6918-4b05-a99a-7391aa44926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:00.128141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b49dbebf-6918-4b05-a99a-7391aa44926a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:58:00.129309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b49dbebf-6918-4b05-a99a-7391aa44926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:58:00.157748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:00.195485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 635/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:58:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:58:00.463883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410f07-119f-4cf0-b26d-b29bf99b11a9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:00.494677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:00.581352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410f07-119f-4cf0-b26d-b29bf99b11a9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:00.615843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:00.616442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:00.616719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:00.616988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:00.617637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:00.619044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fa346-4707-4bfc-8531-5510da9186d1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:00.632564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 660/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 14:58:00 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:58:02.799683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c236-860b-4e52-bb1b-9b102ea8c7c0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:02.800218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c236-860b-4e52-bb1b-9b102ea8c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:02.800218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c236-860b-4e52-bb1b-9b102ea8c7c0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:02.801824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 636/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:58:02.806971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:02.807385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:02.807512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:02.825337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:58:02.826541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:58:02.895782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 661/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:58:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 14:58:03.164685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33c236-860b-4e52-bb1b-9b102ea8c7c0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:03.263628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33c236-860b-4e52-bb1b-9b102ea8c7c0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:03.295647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:03.296259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:03.296532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:03.296794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:03.297357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:03.298769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:58:03.307344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:58:03.308501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:03.309545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 637/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:58:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:58:03.314755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:03.332694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:03.412913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742ed9e-51be-42f8-b7df-c07ab54e0129 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:03.444972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:03.445513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:03.445786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:03.446049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:03.446685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:58:03.446985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:03.448330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:03.453956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 662/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 14:58:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:58:03.459731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:03.490800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:03.566858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9f77-bc4f-4515-b305-e3ee4f6fd273 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:03.599273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:03.599860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:03.600132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:03.600397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:03.601077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] RBAC: Adding query filter params (interface=public, service_id=73204a127cc04e359ba96bc3664c933c, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:58:03.601378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:03.602780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd450500-d8c1-4e31-a12d-74a37cec60a6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:03.607544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 638/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 14:58:03 2022] GET /identity/v3/endpoints?service_id=73204a127cc04e359ba96bc3664c933c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:58:03.613709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:03.693004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:03.711011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d74680-7f5c-4ac8-ae42-1b1054114c6e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:03.743326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:03.743917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:03.744191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:03.744458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:03.745055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:03.746441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca452de-399e-4cf7-b47b-c70de7054577 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:03.753647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 663/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 14:58:03 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 14:58:05.857376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613acf-3478-475f-b2f3-41ede9b939a1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:05.857903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613acf-3478-475f-b2f3-41ede9b939a1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:05.857903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613acf-3478-475f-b2f3-41ede9b939a1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:05.859274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 639/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:58:05.864413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:05.864855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:05.864973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:05.882831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:58:05.884016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:58:05.948842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 664/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:58:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 14:58:06.213522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613acf-3478-475f-b2f3-41ede9b939a1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:06.305693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:06.312468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613acf-3478-475f-b2f3-41ede9b939a1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:06.344743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:06.345357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:06.345631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:06.345895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:06.346494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:06.347840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 14:58:06.356478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 14:58:06.357673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 14:58:06.358675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 11 14:58:06.362428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 640/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 14:58:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 14:58:06.364082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:06.439245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:06.462143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152257-5b07-4c80-8aa5-9665bb8ef714 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:06.495348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:06.495879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:06.496153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:06.496419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:06.497032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 14:58:06.497329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:06.498714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619129a-3ee0-4e5c-b656-6ef6ab72c65d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:06.503683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 665/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 14:58:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 14:58:06.509462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:58:06.607374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f821-f1f3-48ec-bdf7-0f268247c77c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:58:06.640447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:58:06.641059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:58:06.641334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:58:06.641597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:58:06.642248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:58:06.643620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8d3b-e918-4cf0-989a-3029efdc79bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:58:06.662080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 641/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 14:58:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 14:58:16.500806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=30 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:58:16.657896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:10.304532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54141-0657-4219-91f5-40f263b08624 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:10.305169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54141-0657-4219-91f5-40f263b08624 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:10.305169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54141-0657-4219-91f5-40f263b08624 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:10.310582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 666/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:10.311902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ffb3-f5f5-4f6e-b96e-a30cb732b1c4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:10.312352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ffb3-f5f5-4f6e-b96e-a30cb732b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:10.312442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ffb3-f5f5-4f6e-b96e-a30cb732b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:10.424294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cb65ffb3-f5f5-4f6e-b96e-a30cb732b1c4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:10.425745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb65ffb3-f5f5-4f6e-b96e-a30cb732b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:10.546590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 642/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 14:59:10.844283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:10.845061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:10.845548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:10.847926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 667/1309] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 14:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:10.853519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f2f5-7403-4cc4-b13b-4eeaddabeb82 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:10.854159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f2f5-7403-4cc4-b13b-4eeaddabeb82 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:10.854672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f2f5-7403-4cc4-b13b-4eeaddabeb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:10.949317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6749f2f5-7403-4cc4-b13b-4eeaddabeb82 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:10.951344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6749f2f5-7403-4cc4-b13b-4eeaddabeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:10.987574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:11.039274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 643/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:11.049027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:11.051480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:11.168749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25f7d-f31f-45eb-9d0a-cfdf1b25c15d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:11.245899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:11.246569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:11.246845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:11.247110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:11.249840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:11.310100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:11.371458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:11.372922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d6f5-3655-4805-8f5d-5f83d610c7ab service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:11.391833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 668/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 14:59:13.865300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:13.865844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:13.865938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:13.867265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 644/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:13.872549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8166e2-f4da-4856-9a37-f578fc671151 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:13.872972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8166e2-f4da-4856-9a37-f578fc671151 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:13.873093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8166e2-f4da-4856-9a37-f578fc671151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:13.942939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-af8166e2-f4da-4856-9a37-f578fc671151 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:13.944131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af8166e2-f4da-4856-9a37-f578fc671151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:14.038358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 669/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:14.318129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:14.319714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:14.424226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a326-ff5b-4642-85f8-a30a910ba6ab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:14.497409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:14.499773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:14.500630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:14.501158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:14.501489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:14.503348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:14.611616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:14.612958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6bca-9faa-4afc-ad65-de01d8e42eb7 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:14.631414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 645/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:17.096202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:17.096765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:17.096765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:17.098089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 670/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:17.103442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429baa0-741a-4b04-be14-507ea796a780 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:17.103865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429baa0-741a-4b04-be14-507ea796a780 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:17.103974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429baa0-741a-4b04-be14-507ea796a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:17.168105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0429baa0-741a-4b04-be14-507ea796a780 None None] MFA Rules not processed for user `2b3d5c3114f543a9baef9814c1ab6287`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:17.169809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0429baa0-741a-4b04-be14-507ea796a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:17.220121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:17.264442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 646/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:17.545041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:17.546626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:17.556590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:17.652543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f682e8c-6301-4dd3-912b-e9fc14a8b0a0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:17.723865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:17.724456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:17.724729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:17.724992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:17.726605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:17.786589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:17.833277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:17.834680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78c9f-afdb-4af0-a594-9d63593aed2c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:17.851932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 671/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:20.511194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:20.511759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:20.511759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:20.513733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 647/1318] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:20.518929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b34b2-7e91-4d46-bd4e-6018735bb260 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:20.519358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b34b2-7e91-4d46-bd4e-6018735bb260 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:20.519477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b34b2-7e91-4d46-bd4e-6018735bb260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:20.587567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6c8b34b2-7e91-4d46-bd4e-6018735bb260 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:20.588760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c8b34b2-7e91-4d46-bd4e-6018735bb260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:20.682535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 672/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:20.964113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:20.966242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:21.066505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9371-978b-49e1-93c9-f8f9237e3b7f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:21.138406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:21.139006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:21.139282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:21.139557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:21.141167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:21.147900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:21.249255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:21.250622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0f62-6c2b-4a17-b6c4-cd0b89154caf service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:21.268576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 648/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:24.052719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:24.053241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:24.053332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:24.054694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 673/1321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:24.060501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10c9b-6940-481d-b73e-481f007af2d1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:24.060946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10c9b-6940-481d-b73e-481f007af2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:24.061050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10c9b-6940-481d-b73e-481f007af2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:24.132976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-69f10c9b-6940-481d-b73e-481f007af2d1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:24.134206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69f10c9b-6940-481d-b73e-481f007af2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:24.196632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:24.239168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 649/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:24.525769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:24.527326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:24.547468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:24.639391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231759d-1b90-4285-97ae-5be4030d9169 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:24.712701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:24.713302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:24.713574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:24.713839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:24.716113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:24.784457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:24.822177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:24.823800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19728a41-9c2c-4d8d-99bb-c609ee201988 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:24.842185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 674/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:27.046715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:27.047280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:27.047280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:27.048629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 650/1324] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:27.054072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32970a-970e-48a4-82b7-9b362ad5ff83 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:27.054551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32970a-970e-48a4-82b7-9b362ad5ff83 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:27.054644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32970a-970e-48a4-82b7-9b362ad5ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:27.123934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cf32970a-970e-48a4-82b7-9b362ad5ff83 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:27.125135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf32970a-970e-48a4-82b7-9b362ad5ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:27.226717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 675/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:27.512977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:27.514485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:27.615863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97515daf-f824-4fc7-a60b-f76a2facde66 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:27.688635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:27.689231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:27.689508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:27.689776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:27.691416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:27.708745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:27.802822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:27.804178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea918d0-5967-4538-a80d-a4a1df7cc03b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:27.822514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 651/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:30.048490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265006e5-0d14-4488-b8da-e153b79b9d4a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:30.049032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265006e5-0d14-4488-b8da-e153b79b9d4a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:30.049032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265006e5-0d14-4488-b8da-e153b79b9d4a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:30.050420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 676/1327] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:30.055955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d17cf-fd72-4173-8029-5ba106312d63 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:30.056409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d17cf-fd72-4173-8029-5ba106312d63 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:30.056530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d17cf-fd72-4173-8029-5ba106312d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:30.122451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f94d17cf-fd72-4173-8029-5ba106312d63 None None] MFA Rules not processed for user `2b3d5c3114f543a9baef9814c1ab6287`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:30.123578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f94d17cf-fd72-4173-8029-5ba106312d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:30.188914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:30.221000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 652/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:30.516366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:30.516644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:30.516915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:30.518287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 677/1329] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 14:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:30.524446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871803c-4213-4720-ab9e-2328bb1a03d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:30.524733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871803c-4213-4720-ab9e-2328bb1a03d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:30.525007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871803c-4213-4720-ab9e-2328bb1a03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:30.608084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a871803c-4213-4720-ab9e-2328bb1a03d3 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:30.609302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a871803c-4213-4720-ab9e-2328bb1a03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:30.688307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 653/1330] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:30.697001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:30.698580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:30.728842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:30.805887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1ede-2237-4637-b3dd-1561e288f2b8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:30.880951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:30.881546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:30.881817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:30.882080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:30.883679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:30.959584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:30.997608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:30.999074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384334c6-1c1d-4187-892b-e87f834c361d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:31.017121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 678/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:33.814369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:33.814903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:33.814903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:33.816266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 654/1332] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:33.821610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d908a3-262d-4f06-8356-8d155fd492ad None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:33.822008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d908a3-262d-4f06-8356-8d155fd492ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:33.822158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d908a3-262d-4f06-8356-8d155fd492ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:33.886599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-94d908a3-262d-4f06-8356-8d155fd492ad None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:33.887834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94d908a3-262d-4f06-8356-8d155fd492ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:33.986059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 679/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:34.266793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:34.268329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:34.337433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:34.370917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1b69-38ba-494c-bc77-76c391a1bdea None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:34.442998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:34.443595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:34.443871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:34.444140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:34.445714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:34.552490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:34.553878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09004a-0de9-4284-aa08-4b4993883631 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:34.564125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:34.572699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 655/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:36.755483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:36.756070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:36.756070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:36.757354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 680/1335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:36.762560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb812a-405b-4371-8c48-28b0dd68fa7c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:36.762939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb812a-405b-4371-8c48-28b0dd68fa7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:36.763119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb812a-405b-4371-8c48-28b0dd68fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:36.828645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6edb812a-405b-4371-8c48-28b0dd68fa7c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:36.829847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6edb812a-405b-4371-8c48-28b0dd68fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:36.942858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 656/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:37.225365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:37.226988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:37.268095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:37.330425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013c17b-6f73-4bed-b8c4-ba4c83be11bc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:37.401627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:37.402218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:37.403151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:37.403415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:37.404978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:37.485535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:37.510445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:37.512405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261994-e12b-460c-9ad1-44c2d6d305e8 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:37.530324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 681/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:39.979958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:39.980452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:39.981116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:39.982538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 657/1338] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:39.987915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfc10-6cbd-4d66-8ac1-5eaa69b87b03 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:39.988334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfc10-6cbd-4d66-8ac1-5eaa69b87b03 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:39.988442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfc10-6cbd-4d66-8ac1-5eaa69b87b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:40.053106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8cfcfc10-6cbd-4d66-8ac1-5eaa69b87b03 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:40.054348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8cfcfc10-6cbd-4d66-8ac1-5eaa69b87b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:40.146219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 682/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:40.424103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:40.425632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:40.501029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:40.530439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c295a9-a90f-411b-b391-c71deefe7254 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:40.602888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:40.603422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:40.603697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:40.603965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:40.606120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:40.711371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:40.712796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab6146-4c44-41a9-8f13-b8cb635915ab service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:40.730239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 658/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:44.849752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bec4-3463-4123-b452-ced242525466 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:44.850398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bec4-3463-4123-b452-ced242525466 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:44.850398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bec4-3463-4123-b452-ced242525466 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:44.851614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 683/1341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:44.856862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716dcd-ea27-4b47-801c-59bc2909bd67 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:44.857300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716dcd-ea27-4b47-801c-59bc2909bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:44.857450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716dcd-ea27-4b47-801c-59bc2909bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:44.863356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:44.925363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1c716dcd-ea27-4b47-801c-59bc2909bd67 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:44.926879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c716dcd-ea27-4b47-801c-59bc2909bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:45.023778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 659/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:45.307395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bec4-3463-4123-b452-ced242525466 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:45.308990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33c1bec4-3463-4123-b452-ced242525466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:45.358115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:45.414743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bec4-3463-4123-b452-ced242525466 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:45.490618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:45.491221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:45.491498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:45.491766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:45.493351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:45.590552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:45.607435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:45.608876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e0595-bc0e-4173-87bb-5a992fcce35b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:45.626592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 684/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:48.451790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f028-c174-40fd-96bd-30801c937160 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:48.452366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f028-c174-40fd-96bd-30801c937160 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:48.452627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f028-c174-40fd-96bd-30801c937160 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:48.454004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 660/1344] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:48.459193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f402-f8b9-42d7-ba09-4aaa53fcf090 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:48.459614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f402-f8b9-42d7-ba09-4aaa53fcf090 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:48.459726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f402-f8b9-42d7-ba09-4aaa53fcf090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:48.530041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-afd9f402-f8b9-42d7-ba09-4aaa53fcf090 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:48.531368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-afd9f402-f8b9-42d7-ba09-4aaa53fcf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:48.630670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 685/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:48.911640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f028-c174-40fd-96bd-30801c937160 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:48.913169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9103f028-c174-40fd-96bd-30801c937160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:49.007193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:49.025249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f028-c174-40fd-96bd-30801c937160 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:49.100980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:49.101618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:49.101893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:49.102157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:49.103797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:49.212679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:49.214136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b740b-7f17-4022-820e-f6248f27b1fc service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:49.232554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 661/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 14:59:53.679211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:53.679744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:53.679888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:53.681257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 686/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 14:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:53.686588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637bb7-0617-4b8a-bb37-1838890337d4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:53.687006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637bb7-0617-4b8a-bb37-1838890337d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:53.687177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637bb7-0617-4b8a-bb37-1838890337d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:53.703678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:53.763583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8b637bb7-0617-4b8a-bb37-1838890337d4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:53.765065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8b637bb7-0617-4b8a-bb37-1838890337d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:53.872843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 662/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 14:59:54.152689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 14:59:54.154282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:54.211457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:54.255631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aeffe-08e5-469f-907e-4bfb13f4b945 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 14:59:54.326366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 14:59:54.326959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:54.327231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:54.327496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:54.329052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:54.433096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 14:59:54.436272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 14:59:54.438003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9caed0-17c3-4cd0-9b7a-178ec48331e9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 14:59:54.456742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 687/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 14:59:59.406183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198ed4-78f5-4bb1-9298-9254f1f88cbf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:59.406755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198ed4-78f5-4bb1-9298-9254f1f88cbf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:59.406755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198ed4-78f5-4bb1-9298-9254f1f88cbf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:59.408369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 663/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 14:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 14:59:59.414399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6058-2e0d-4032-a5dd-5ef5ca949468 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 14:59:59.414847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6058-2e0d-4032-a5dd-5ef5ca949468 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 14:59:59.415169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6058-2e0d-4032-a5dd-5ef5ca949468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 14:59:59.541496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3f9f6058-2e0d-4032-a5dd-5ef5ca949468 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 14:59:59.543669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f9f6058-2e0d-4032-a5dd-5ef5ca949468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 14:59:59.663808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 688/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 14:59:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:03.780241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29547-243d-4792-a606-6256fe8a7f22 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:03.780802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29547-243d-4792-a606-6256fe8a7f22 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:03.780802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29547-243d-4792-a606-6256fe8a7f22 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:03.782291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 664/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:03.787853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481bf12-c88b-4770-adac-132621c5dff1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:03.788778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481bf12-c88b-4770-adac-132621c5dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:03.789284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481bf12-c88b-4770-adac-132621c5dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:03.850396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:03.870777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=59 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:03.879860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6481bf12-c88b-4770-adac-132621c5dff1 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:03.881084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6481bf12-c88b-4770-adac-132621c5dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:04.004644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 689/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:00:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:05.357104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72027-4e2e-46ed-a814-bbd33eb92918 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:05.357620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72027-4e2e-46ed-a814-bbd33eb92918 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:05.357620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72027-4e2e-46ed-a814-bbd33eb92918 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:05.358950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 665/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:05.363970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ef3e3-8f48-4231-91fb-38129ba975ef None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:05.364433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ef3e3-8f48-4231-91fb-38129ba975ef None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:05.364541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ef3e3-8f48-4231-91fb-38129ba975ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:05.442875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5c2ef3e3-8f48-4231-91fb-38129ba975ef None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:05.444093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5c2ef3e3-8f48-4231-91fb-38129ba975ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:05.489172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:05.556625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 690/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:00:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:09.085530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18c27-5586-4d75-a519-b27fde2093f8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:09.086423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18c27-5586-4d75-a519-b27fde2093f8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:09.086849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18c27-5586-4d75-a519-b27fde2093f8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:09.091663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 666/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:09.094447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73587-f7d4-4c2e-8014-9d19315a6e75 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:09.094890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73587-f7d4-4c2e-8014-9d19315a6e75 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:09.094973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73587-f7d4-4c2e-8014-9d19315a6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:09.166046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b8d73587-f7d4-4c2e-8014-9d19315a6e75 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:09.167767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b8d73587-f7d4-4c2e-8014-9d19315a6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:09.275779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 691/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:09.585824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:09.586109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:09.586604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:09.587942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 667/1358] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 15:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:09.597509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37868-23fa-47ca-a1c3-f25d78e5f78b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:09.597966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37868-23fa-47ca-a1c3-f25d78e5f78b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:09.598411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37868-23fa-47ca-a1c3-f25d78e5f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:09.621591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:09.686180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-07e37868-23fa-47ca-a1c3-f25d78e5f78b None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:09.687403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07e37868-23fa-47ca-a1c3-f25d78e5f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:09.810546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 692/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:09.818521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:09.820031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:09.978246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2af26-2256-4b0c-8f54-202f9cbfd979 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:10.061142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:10.110604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:10.111334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:10.111617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:10.111885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:10.113704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:10.220787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:10.223453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4cd7b-0931-4ca1-a0c4-7bb51b9e5139 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:10.242589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 668/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:12.641050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:12.641050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:12.641892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:12.646787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 693/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:12.648174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224c666-2885-474e-b80c-49cc6baf162c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:12.648764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224c666-2885-474e-b80c-49cc6baf162c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:12.648764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224c666-2885-474e-b80c-49cc6baf162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:12.720247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2224c666-2885-474e-b80c-49cc6baf162c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:12.721439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2224c666-2885-474e-b80c-49cc6baf162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:12.764061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:12.832789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 669/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:00:13.130602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:13.132493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:13.214187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:13.320239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cfc6-2e20-4251-8a8f-17f5f1012e3e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:13.462300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:13.462300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:13.463334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:13.463334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:13.465532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:13.490481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:13.571184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:13.572830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce4a5-c2c1-4e9b-84bf-832f459b8ab2 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:13.595869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 694/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:16.099172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ed5-3467-4a72-a1ad-c976b7dce0e0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:16.099694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ed5-3467-4a72-a1ad-c976b7dce0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:16.099694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ed5-3467-4a72-a1ad-c976b7dce0e0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:16.100993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 670/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:16.106353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de9be-ec3f-47a5-82be-17b74a08b48d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:16.107102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de9be-ec3f-47a5-82be-17b74a08b48d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:16.107592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de9be-ec3f-47a5-82be-17b74a08b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:16.177085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-834de9be-ec3f-47a5-82be-17b74a08b48d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:16.178650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-834de9be-ec3f-47a5-82be-17b74a08b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:16.283427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:16.294579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 695/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:16.576022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:16.576379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:16.576717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:16.578148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 671/1366] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:16.583644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445ece-b6d0-44dd-b611-bdb4130f6d7c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:16.584015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445ece-b6d0-44dd-b611-bdb4130f6d7c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:16.584381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445ece-b6d0-44dd-b611-bdb4130f6d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:16.664380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e7445ece-b6d0-44dd-b611-bdb4130f6d7c None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:16.666016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7445ece-b6d0-44dd-b611-bdb4130f6d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:16.790164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 696/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:16.795518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:16.797134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:16.956317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804d562-d9ec-4860-b82c-81bb9cf86fbf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:16.987182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:17.090461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:17.091067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:17.091340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:17.091606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:17.093174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:17.188721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:17.191757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88f452-a55b-4c1b-b414-758c72b3549c service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:17.218743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 672/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:17.325693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e524-492f-4894-9a59-4b0d20847f92 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:17.326186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e524-492f-4894-9a59-4b0d20847f92 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:17.326499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e524-492f-4894-9a59-4b0d20847f92 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:17.327758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 697/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:17.333329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba824-9722-4cb2-ab40-de4b214d814d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:17.333673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba824-9722-4cb2-ab40-de4b214d814d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:17.333893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba824-9722-4cb2-ab40-de4b214d814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:17.371447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:17.422781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-610ba824-9722-4cb2-ab40-de4b214d814d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:17.424266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-610ba824-9722-4cb2-ab40-de4b214d814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:17.540944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 673/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:17.871966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:17.871966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:17.871966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:17.874483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 698/1371] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 15:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:17.877569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4aca-0828-42f9-8e5f-6b0b84403303 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:17.877850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4aca-0828-42f9-8e5f-6b0b84403303 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:17.878121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4aca-0828-42f9-8e5f-6b0b84403303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:17.957389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-932e4aca-0828-42f9-8e5f-6b0b84403303 None None] MFA Rules not processed for user `2ff83fd91f594d97af82492a1eb344af`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:17.958639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-932e4aca-0828-42f9-8e5f-6b0b84403303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:18.017639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:18.052204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 674/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:18.060273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:18.061790 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:18.116638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:18.172810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995afa5-76e7-4f9a-a993-ce383ec6b9aa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:18.257123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:18.258313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:18.258529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:18.258895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:18.261216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:18.377096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:18.395780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:18.397527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67123c-a3ca-4fe5-a341-5d518e07f465 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:18.419093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 699/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:00:19.493666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:19.494229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:19.494229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:19.495618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 675/1374] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:19.500851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8fac-c733-43cf-bffd-bea74857cf02 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:19.501241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8fac-c733-43cf-bffd-bea74857cf02 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:19.501538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8fac-c733-43cf-bffd-bea74857cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:19.570913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-510e8fac-c733-43cf-bffd-bea74857cf02 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:19.572133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-510e8fac-c733-43cf-bffd-bea74857cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:19.667547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 700/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:19.964477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:19.966031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:20.118778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8a9aa-63a3-4770-b1ce-838f018d26d8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:20.171157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:20.236890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:20.237578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:20.237859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:20.238126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:20.239808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:20.342540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:20.344147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09760149-8470-417c-b219-13f52dce9a37 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:20.363812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 676/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:22.577351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:22.577902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:22.577902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:22.579426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 701/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:22.584421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a405a-91f5-4c95-9d33-6de2fac5ae9c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:22.584829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a405a-91f5-4c95-9d33-6de2fac5ae9c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:22.585010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a405a-91f5-4c95-9d33-6de2fac5ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:22.654391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-712a405a-91f5-4c95-9d33-6de2fac5ae9c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:22.656032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-712a405a-91f5-4c95-9d33-6de2fac5ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:22.665183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:22.765378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 677/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:23.059456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:23.061097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:23.125025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:23.211814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeee00e-d144-4c30-9a52-799478e97cad None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:23.327029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:23.327550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:23.327826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:23.328097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:23.329658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:23.349717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:23.430249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:23.432035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cb90-1d9a-41c3-8302-4e6cfc830453 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:23.451215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 702/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:25.675971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:25.676431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:25.676511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:25.678018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 678/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:25.683657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed76a-a16a-4041-b7d6-896f13914533 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:25.684058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed76a-a16a-4041-b7d6-896f13914533 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:25.684234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed76a-a16a-4041-b7d6-896f13914533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:25.762970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-356ed76a-a16a-4041-b7d6-896f13914533 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:25.764172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-356ed76a-a16a-4041-b7d6-896f13914533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:25.885241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:25.892519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 703/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:26.190049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:26.192133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:26.340113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:26.353863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d06c-1583-4bba-a5da-e27db435fdff None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:26.473173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:26.473774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:26.474052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:26.474340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:26.475920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:26.567167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:26.568796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae668358-7f94-49b0-bbc3-7ead17a488df service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:26.579138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:26.587674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 679/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:28.783097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:28.783602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:28.783791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:28.784974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 704/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:28.790123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383977-47f1-4fa3-8b5b-69008fa2d00e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:28.790544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383977-47f1-4fa3-8b5b-69008fa2d00e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:28.790728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383977-47f1-4fa3-8b5b-69008fa2d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:28.888674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f7383977-47f1-4fa3-8b5b-69008fa2d00e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:28.890955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7383977-47f1-4fa3-8b5b-69008fa2d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:29.005460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 680/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:29.299247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:29.301067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:29.456726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596e51c-d0d3-49d6-bacc-309a7a9e96a2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:29.543858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:29.600725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:29.601586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:29.601943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:29.602325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:29.604681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:29.711815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:29.714298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbede48-3118-46a1-8853-10126d41566e service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:29.737530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 705/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:31.883445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:31.883979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:31.883979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:31.885964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 681/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:31.891826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290ad0-0043-4946-8e2d-42a22bc8e190 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:31.892274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290ad0-0043-4946-8e2d-42a22bc8e190 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:31.892463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290ad0-0043-4946-8e2d-42a22bc8e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:31.961602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1c290ad0-0043-4946-8e2d-42a22bc8e190 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:31.962872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1c290ad0-0043-4946-8e2d-42a22bc8e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:31.998285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:32.063447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 706/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:32.355660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:32.357176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:32.437366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:32.509193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495bf7f-a036-42a9-aa23-a69a29795283 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:32.622652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:32.623154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:32.623431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:32.623694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:32.625260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:32.663456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:32.716480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:32.718082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8affa-a16d-4e9d-9a43-d46f05301c0b service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:32.735863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 682/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:33.643062 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761f20-8a93-4ae7-93bc-8fc4e63ece7e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:33.643630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761f20-8a93-4ae7-93bc-8fc4e63ece7e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:33.643630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761f20-8a93-4ae7-93bc-8fc4e63ece7e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:33.645019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 707/1389] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:33.650723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a387-dd25-402f-aa33-d06cd8931535 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:33.651314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a387-dd25-402f-aa33-d06cd8931535 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:33.651314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a387-dd25-402f-aa33-d06cd8931535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:33.720535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8897a387-dd25-402f-aa33-d06cd8931535 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:33.721743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8897a387-dd25-402f-aa33-d06cd8931535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:33.822777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 683/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:34.120722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:34.121015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:34.121284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:34.122673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 708/1391] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 15:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:34.128137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35fad-4b12-4d51-aa61-2c8aff01f184 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:34.128496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35fad-4b12-4d51-aa61-2c8aff01f184 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:34.128843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35fad-4b12-4d51-aa61-2c8aff01f184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:34.145268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:34.207010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c3e35fad-4b12-4d51-aa61-2c8aff01f184 None None] MFA Rules not processed for user `9dab615c85bb4e50b46a69e92b33963e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:34.208232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c3e35fad-4b12-4d51-aa61-2c8aff01f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:34.284780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 684/1392] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:34.294249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:34.295848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:34.404008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a146-5de1-4c7e-873a-aa123fb698c5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:34.461886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:34.477795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:34.478603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:34.478884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:34.479152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:34.480741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:34.592671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:34.594023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb572e4-2de4-4127-9bf1-b8c1d1936101 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:34.611814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 709/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:34.935853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141bc8c-47d0-4b76-8d75-58aa96cb7486 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:34.936417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141bc8c-47d0-4b76-8d75-58aa96cb7486 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:34.936417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141bc8c-47d0-4b76-8d75-58aa96cb7486 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:34.938019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 685/1394] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:34.943111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:34.943532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:34.943842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.030292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:35.031524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:35.071577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:35.130008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 710/1395] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:35.361567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d042e4-b81f-44a8-9557-d27b08b86b1c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:35.361848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d042e4-b81f-44a8-9557-d27b08b86b1c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:35.362119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d042e4-b81f-44a8-9557-d27b08b86b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.423311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:35.424510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:35.432178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b5d042e4-b81f-44a8-9557-d27b08b86b1c None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:35.433353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5d042e4-b81f-44a8-9557-d27b08b86b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:35.489146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:35.523383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 686/1396] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:35.543600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295de09-0bdd-495f-963f-a7e2843ace17 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:35.570570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d257-469a-46ff-9afe-b0db98962f0b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:35.570860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d257-469a-46ff-9afe-b0db98962f0b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:35.571138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d257-469a-46ff-9afe-b0db98962f0b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.572702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 687/1397] 10.222.0.16 () {54 vars in 943 bytes} [Sun Sep 11 15:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:00:35.579052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:35.579334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:35.579605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.601497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:35.657489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] MFA Rules not processed for user `f8f8f0c6b4b049debb3e963dd3b7916b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:35.658776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:35.660291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:35.660891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:35.661162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:35.661435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.663057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:35.755853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:35.757236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f454-4078-4fdd-abdf-a330a8ea1666 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:35.768747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 688/1398] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 11 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:00:35.776225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 711/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:00:35.778844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:35.788183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bad1f-b93b-4c6d-b412-4e0526080ad7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:35.813987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:35.906515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:35.907132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:35.907409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:35.907677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:35.909370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:36.003767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:36.005373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87fe2-81c4-41c1-9563-c43189a5422e service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:36.014415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 689/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:00:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 15:00:38.037325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:38.037856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:38.037856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:38.039558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 712/1401] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:38.044339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acd11-19d5-418c-9fd0-e6245ea51fd9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:38.044736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acd11-19d5-418c-9fd0-e6245ea51fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:38.044886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acd11-19d5-418c-9fd0-e6245ea51fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:38.120850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b57acd11-19d5-418c-9fd0-e6245ea51fd9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:38.122354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b57acd11-19d5-418c-9fd0-e6245ea51fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:38.132734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:38.234322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 690/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:38.520297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:38.521843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:38.593375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:38.679403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb6e7-de54-4393-96e3-128b785ba497 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:38.807915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:38.808437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:38.808711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:38.808978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:38.810593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:38.837301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:38.921749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:38.923406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630430db-caf1-4623-b096-6e2a2c5fe0a9 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:38.945519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 713/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:41.179976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:41.180524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:41.180524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:41.188465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6adf-f4d9-4675-9d08-b604bf47ec1e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:41.189026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6adf-f4d9-4675-9d08-b604bf47ec1e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:41.189125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6adf-f4d9-4675-9d08-b604bf47ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:41.194401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 691/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:41 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:41.287755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f9ff6adf-f4d9-4675-9d08-b604bf47ec1e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:41.287755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f9ff6adf-f4d9-4675-9d08-b604bf47ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:41.412083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 714/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:41.715598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:41.717461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:41.870022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:41.880654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290bf4e-73c2-40f8-a267-391a958810b7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:42.007251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:42.007856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:42.008132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:42.008390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:42.010025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:42.122325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:42.123937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d0e5-7a7c-4226-8ef8-d95a09791473 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:42.134823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:42.143908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 692/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:44.373631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:44.374855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:44.375269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:44.378311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 715/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:00:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:44.383143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68403e-9c30-4c67-8cd9-f3a624db84c3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:44.383948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68403e-9c30-4c67-8cd9-f3a624db84c3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:44.384229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68403e-9c30-4c67-8cd9-f3a624db84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:44.461242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-be68403e-9c30-4c67-8cd9-f3a624db84c3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:44.463046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-be68403e-9c30-4c67-8cd9-f3a624db84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:44.577835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 693/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:44.899739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:00:44.901468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:44.904537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:45.078645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d4ba6-420b-4a72-8aa9-0100a4785397 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:00:45.162065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:45.213662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:00:45.214301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:45.214580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:45.214853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:45.216626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:45.314069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:00:45.316020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c3ef-db70-42ee-94ea-3330a7d5df5e service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:00:45.346409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 716/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:00:54.576346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=67 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:55.339009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=61 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:58.786912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202b5f-08e5-4ec3-9592-cd18a0776e55 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:58.787481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202b5f-08e5-4ec3-9592-cd18a0776e55 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:58.787481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202b5f-08e5-4ec3-9592-cd18a0776e55 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:58.788886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 694/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 15:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:58.794489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056cb1-11cb-4871-8536-4109b7218cf0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:58.794880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056cb1-11cb-4871-8536-4109b7218cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:58.795091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056cb1-11cb-4871-8536-4109b7218cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:58.873248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3c056cb1-11cb-4871-8536-4109b7218cf0 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:58.874508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3c056cb1-11cb-4871-8536-4109b7218cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:58.981055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 717/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:00:58.996251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd503c-64cf-4383-a44f-28dfa3e905d1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:58.996535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd503c-64cf-4383-a44f-28dfa3e905d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:58.996810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd503c-64cf-4383-a44f-28dfa3e905d1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:58.998141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 695/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 15:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:00:59.003172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac9bfc-9921-4b06-8029-3d5f1dbef64c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:00:59.003463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac9bfc-9921-4b06-8029-3d5f1dbef64c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:00:59.003739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac9bfc-9921-4b06-8029-3d5f1dbef64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:00:59.077003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:00:59.079726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-49ac9bfc-9921-4b06-8029-3d5f1dbef64c None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:00:59.081439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-49ac9bfc-9921-4b06-8029-3d5f1dbef64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:00:59.198968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 718/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:01.795341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:01.795841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:01.795946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:01.797228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:01.802787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63970916-51b8-4a36-afad-c3ce896f5181 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:01.803179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63970916-51b8-4a36-afad-c3ce896f5181 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:01.803341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63970916-51b8-4a36-afad-c3ce896f5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:01.869365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63970916-51b8-4a36-afad-c3ce896f5181 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:01.870600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63970916-51b8-4a36-afad-c3ce896f5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:01.924049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:01.966684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:02.256822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:02.258387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:02.408548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea705b-f36b-443d-aad5-ddd9a25fe5be None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:02.480886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:02.521346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:02.521881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:02.522154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:02.522456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:02.524069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:02.611838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:02.613427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7aa15-3ca4-450d-91d0-0913f43690a1 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:02.631456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 697/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:03.766633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da334b-a256-43c8-b658-672306abc598 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:03.767207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da334b-a256-43c8-b658-672306abc598 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:03.767207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da334b-a256-43c8-b658-672306abc598 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:03.768543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:03.775250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ba5e-b54d-4603-8b49-e95fae10a2b6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:03.775687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ba5e-b54d-4603-8b49-e95fae10a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:03.775827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ba5e-b54d-4603-8b49-e95fae10a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:03.854922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5c92ba5e-b54d-4603-8b49-e95fae10a2b6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:03.856115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5c92ba5e-b54d-4603-8b49-e95fae10a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:03.882712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:03.953320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:04.104146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da334b-a256-43c8-b658-672306abc598 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:04.105677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-30da334b-a256-43c8-b658-672306abc598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:04.249955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da334b-a256-43c8-b658-672306abc598 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:04.289438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:04.360475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:04.360997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:04.361271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:04.361534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:04.363138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:04.451921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:04.453541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fafc3-029a-4fc4-a80f-90f0fbd811e2 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:04.473183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 721/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:05.608921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:05.609518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:05.609518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:05.610838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:05.616947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad93a66-d916-4f3e-9c4f-c102029d1a8f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:05.617360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad93a66-d916-4f3e-9c4f-c102029d1a8f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:05.617490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad93a66-d916-4f3e-9c4f-c102029d1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:05.671271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:05.693555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ad93a66-d916-4f3e-9c4f-c102029d1a8f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:05.694784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ad93a66-d916-4f3e-9c4f-c102029d1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:05.789940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:05.940224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:05.941740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:06.084171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93980fd-4679-470f-9494-4c404e7f6590 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:06.096459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:06.195030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:06.195542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:06.195819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:06.196088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:06.198197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:06.285253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:06.286864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb87ea-1e5f-4eb5-983b-543621eddac5 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:06.304468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 700/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:07.418073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:07.418647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:07.418758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:07.420057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:07.426654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96b95-326b-4e39-8bde-4f5e760796cf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:07.427106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96b95-326b-4e39-8bde-4f5e760796cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:07.427201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96b95-326b-4e39-8bde-4f5e760796cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:07.446518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:07.503875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-95d96b95-326b-4e39-8bde-4f5e760796cf None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:07.505152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95d96b95-326b-4e39-8bde-4f5e760796cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:07.602926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:07.752036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:07.753527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:07.863085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:07.898534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3b727-91fc-44b0-a78c-2841c39f160a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:08.012334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:08.012872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:08.013149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:08.013421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:08.015120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:08.090431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:08.104225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:08.105827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46aa7-a870-452f-843c-bfa791a72b31 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:08.123946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 724/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:09.232140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:09.232712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:09.232712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:09.234376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:09.241521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1315-b0be-49e6-a960-cb79258b0ee6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:09.241997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1315-b0be-49e6-a960-cb79258b0ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:09.242102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1315-b0be-49e6-a960-cb79258b0ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:09.317493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6dad1315-b0be-49e6-a960-cb79258b0ee6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:09.318732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6dad1315-b0be-49e6-a960-cb79258b0ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:09.413545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:09.563278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:09.564734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:09.648030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:09.709849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f161-420b-4cd6-adbb-97095e5b19ef None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:09.824460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:09.824993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:09.825269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:09.825541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:09.827185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:09.875108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:09.916996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:09.918614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086d00-5e39-4de6-9e3a-fe821d25ec03 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:09.936127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 703/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:10.981256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:10.981715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:10.981816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:10.983184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:10.989418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c7a1-3d00-4922-8c4b-7160c8b1cce4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:10.989875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c7a1-3d00-4922-8c4b-7160c8b1cce4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:10.989980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c7a1-3d00-4922-8c4b-7160c8b1cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:11.066389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-43a0c7a1-3d00-4922-8c4b-7160c8b1cce4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:11.067599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-43a0c7a1-3d00-4922-8c4b-7160c8b1cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:11.163075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:01:11.314627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:11.316058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:11.364420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:11.466692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662f936-5825-44ef-a3bc-2ce83f944722 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:11.577296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:11.577818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:11.578091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:11.578386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:11.579959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:11.586664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:11.667854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:11.669404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d4bb-0308-4f53-9a70-e098fd4dc55b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:11.687765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 727/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:12.725540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:12.726123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:12.726123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:12.727438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:12.734095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f61c-9e9b-4276-903e-50f8df7a57df None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:12.734527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f61c-9e9b-4276-903e-50f8df7a57df None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:12.734694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f61c-9e9b-4276-903e-50f8df7a57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:12.809216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c438f61c-9e9b-4276-903e-50f8df7a57df None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:12.810449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c438f61c-9e9b-4276-903e-50f8df7a57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:12.876447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:12.906127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:13.054653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:13.056211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:13.074146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:13.199835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1db9f5-ce2b-4b80-aa29-a1905d282587 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:13.285898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:13.311941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:13.312542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:13.312819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:13.313088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:13.314742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:13.401743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:13.403378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9930213-4bd3-4645-8585-aedccb03e66d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:13.421163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 706/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:14.470877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:14.471671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:14.471671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:14.472782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:14.479770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251dc69-c426-4d2a-af11-a5fbe8f3bb60 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:14.480223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251dc69-c426-4d2a-af11-a5fbe8f3bb60 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:14.480312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251dc69-c426-4d2a-af11-a5fbe8f3bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:14.560787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c251dc69-c426-4d2a-af11-a5fbe8f3bb60 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:14.561943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c251dc69-c426-4d2a-af11-a5fbe8f3bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:14.610923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:14.670424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:14.829408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:14.831366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:14.986829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92799-e4a5-41fb-b8f4-cb3a2973d667 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:15.041986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:15.101954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:15.102503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:15.102807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:15.103074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:15.104665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:15.204414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:15.207030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c1813-30e2-4e8b-88e8-5391ddff2d45 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:15.235456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 730/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:16.288086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515915-6043-4160-b5aa-78298a1872ef None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:16.288630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515915-6043-4160-b5aa-78298a1872ef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:16.288630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515915-6043-4160-b5aa-78298a1872ef None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:16.289973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:16.296055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aaef8-710c-48b0-865f-f449d84e3dd3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:16.296487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aaef8-710c-48b0-865f-f449d84e3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:16.296596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aaef8-710c-48b0-865f-f449d84e3dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:16.372445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dc9aaef8-710c-48b0-865f-f449d84e3dd3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:16.373643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dc9aaef8-710c-48b0-865f-f449d84e3dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:16.375650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:16.469510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:16.616515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515915-6043-4160-b5aa-78298a1872ef None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:16.617948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-13515915-6043-4160-b5aa-78298a1872ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:16.760419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515915-6043-4160-b5aa-78298a1872ef None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:16.786320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:16.870914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:16.871444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:16.871720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:16.871986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:16.873581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:16.961128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:16.963246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c62553-5bb4-42e1-ad71-8b43449a2db8 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:16.981495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 709/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:19.017126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:19.017716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:19.017716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:19.019030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:19.024301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef07bb-b8d5-45d9-b062-2836ccccbdd1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:19.025241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef07bb-b8d5-45d9-b062-2836ccccbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:19.025457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef07bb-b8d5-45d9-b062-2836ccccbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:19.065848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:19.091825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c9ef07bb-b8d5-45d9-b062-2836ccccbdd1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:19.093024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c9ef07bb-b8d5-45d9-b062-2836ccccbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:19.188395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:19.473057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:19.474685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:19.583114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f6ca-a276-46df-b491-5067582245f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:19.615039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:19.655336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:19.655930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:19.656204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:19.656472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:19.658048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:19.762422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:19.763784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea468e9-5e6b-46ab-b148-c8a17c1e56e2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:19.781557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 733/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:22.038399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:22.038903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:22.038903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:22.040256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:22.045404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d7df-6b5d-44f4-b327-18e823668939 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:22.045815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d7df-6b5d-44f4-b327-18e823668939 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:22.045945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d7df-6b5d-44f4-b327-18e823668939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:22.113150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-97c9d7df-6b5d-44f4-b327-18e823668939 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:22.114395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97c9d7df-6b5d-44f4-b327-18e823668939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:22.126936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:22.209540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:22.491156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:22.492711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:22.594793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8f458-d316-4de4-8f98-e05d1a272379 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:22.607653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:22.666880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:22.667475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:22.667748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:22.668013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:22.669578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:22.773962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:22.775930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9957d-55ae-4e6a-b7a7-6c0eb49c8324 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:22.793206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 712/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:25.243540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:25.244068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:25.244068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:25.245699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:25.250966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6114-52de-48ab-99d4-1907ed7276ba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:25.251431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6114-52de-48ab-99d4-1907ed7276ba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:25.251554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6114-52de-48ab-99d4-1907ed7276ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:25.299526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:25.317941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-794c6114-52de-48ab-99d4-1907ed7276ba None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:25.319191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-794c6114-52de-48ab-99d4-1907ed7276ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:25.418446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:25.700509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:25.702090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:25.803424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda8a4-ebc5-4d84-b25f-ebc358dfc7a4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:25.842431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:25.875357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:25.875951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:25.876224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:25.876488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:25.878048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:25.987021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:25.988454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a205-7044-438a-a4a8-4bcc3fb11763 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:26.006323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 736/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:28.251470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:28.252040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:28.252040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:28.253345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:28.259319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d75d-92b6-4ded-9b30-2c7b407ae423 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:28.259749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d75d-92b6-4ded-9b30-2c7b407ae423 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:28.259855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d75d-92b6-4ded-9b30-2c7b407ae423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:28.325536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-89f9d75d-92b6-4ded-9b30-2c7b407ae423 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:28.326787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89f9d75d-92b6-4ded-9b30-2c7b407ae423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:28.346754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:28.537323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:28.826934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:28.828499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:28.935226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1aaa-0e1f-4c76-953e-fbbcaeb9eb28 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:28.955857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:29.010087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:29.010714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:29.010994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:29.011260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:29.012836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:29.119281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:29.120627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99fd57-c09f-49e1-b482-193648cda0d2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:29.138177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 715/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:31.407912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:31.408463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:31.408463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:31.409831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:31.415269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b73e-dddf-4031-9679-76cd6c422a54 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:31.415690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b73e-dddf-4031-9679-76cd6c422a54 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:31.415825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b73e-dddf-4031-9679-76cd6c422a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:31.480867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:31.483736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8a35b73e-dddf-4031-9679-76cd6c422a54 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:31.485585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8a35b73e-dddf-4031-9679-76cd6c422a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:31.582575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:31.868843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:31.870421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:31.970397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f67ee-44be-4210-b3a6-76d9c5ba70a9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:32.018636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:32.043438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:32.043976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:32.044251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:32.044516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:32.046103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:32.152080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:32.153625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977526e-cbff-4ff7-960b-5bd6ce1e7830 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:32.171545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 739/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:34.364781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:34.365349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:34.365349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:34.366699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:34.372515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fe62-46b6-4d2a-8ad8-51e53b47cd8b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:34.372961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fe62-46b6-4d2a-8ad8-51e53b47cd8b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:34.373074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fe62-46b6-4d2a-8ad8-51e53b47cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:34.438942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6379fe62-46b6-4d2a-8ad8-51e53b47cd8b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:34.440136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6379fe62-46b6-4d2a-8ad8-51e53b47cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:34.468416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:34.534395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:34.825983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:34.827582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:34.933392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b271b-5c97-4d60-be4b-687c7a25e43f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:34.961489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:35.006724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:35.007318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:35.007592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:35.007857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:35.010065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:35.115068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:35.116420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7d448-dee5-475a-8c22-63eb16d5afdd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:35.135208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 718/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:37.315728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:37.316334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:37.316334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:37.317577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:37.323443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628eba6-3e06-424b-a726-61a3e2e134d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:37.323850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628eba6-3e06-424b-a726-61a3e2e134d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:37.323996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628eba6-3e06-424b-a726-61a3e2e134d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:37.389080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8628eba6-3e06-424b-a726-61a3e2e134d3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:37.390293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8628eba6-3e06-424b-a726-61a3e2e134d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:37.398390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:37.486963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:37.773313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:37.775457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:37.882208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b510-2a52-4dfc-a67d-a086d2e8d496 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:37.937960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:37.956254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:37.956892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:37.957169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:37.957437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:37.959077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:38.065217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:38.066619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849833d8-52d8-47c2-86ce-5f86875fe251 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:38.084432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 742/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:40.260463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:40.261033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:40.261033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:40.262352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:40.267818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908d5f-3c68-489f-b737-29e55501897f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:40.268263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908d5f-3c68-489f-b737-29e55501897f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:40.268376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908d5f-3c68-489f-b737-29e55501897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:40.335970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-37908d5f-3c68-489f-b737-29e55501897f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:40.337675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37908d5f-3c68-489f-b737-29e55501897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:40.376516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:40.433850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:40.747529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:40.749073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:40.856511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b5b31-002b-4c4e-8b76-e454b98b4345 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:40.894310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:40.931913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:40.932523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:40.932796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:40.933884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:40.934720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:41.044929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:41.046296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71185a4-904c-4686-92ac-321e2fc95db9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:41.064172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 721/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:43.208372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:43.208945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:43.208945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:43.210247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:43.216120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bbcb-0dff-4ed4-afda-3cc639a86ce1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:43.216563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bbcb-0dff-4ed4-afda-3cc639a86ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:43.216676 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bbcb-0dff-4ed4-afda-3cc639a86ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:43.281992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-baa2bbcb-0dff-4ed4-afda-3cc639a86ce1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:43.283144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-baa2bbcb-0dff-4ed4-afda-3cc639a86ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:43.301209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:43.378646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:43.665309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:43.666871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:43.768980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0efb13-ead6-4cc5-b6ea-3b291628fa38 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:43.835519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:43.842364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:43.842963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:43.843238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:43.843503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:43.845110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:43.951275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:43.952638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938352d-dc91-4e74-bc63-707dc515c8f6 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:43.970454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 745/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:46.119821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:46.120332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:46.120332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:46.121651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:01:46.127136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462f45-cb31-4541-9ca2-0a8258fc19c6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:46.127565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462f45-cb31-4541-9ca2-0a8258fc19c6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:46.127671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462f45-cb31-4541-9ca2-0a8258fc19c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:46.192078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f4462f45-cb31-4541-9ca2-0a8258fc19c6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:01:46.193266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f4462f45-cb31-4541-9ca2-0a8258fc19c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:46.239292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:46.294811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:01:46.583947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:01:46.585484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:46.689223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352241b-ac3b-4ef0-834e-4017a0cfb19a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:01:46.737316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:46.762568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:01:46.763160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:01:46.763433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:01:46.763698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:01:46.765251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:01:46.990169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:01:46.993137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36c75-6041-49b3-94ae-724dee28e581 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:01:47.011355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 724/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:01:56.293261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=22 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:01:57.008967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=66 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:06.956472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d728d2-f805-49a7-8250-3af81a92553e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:06.957046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d728d2-f805-49a7-8250-3af81a92553e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:06.957046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d728d2-f805-49a7-8250-3af81a92553e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:06.958381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 747/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:02:06.963766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422785-219a-41bd-ae96-c4fc6f623f26 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:06.964156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422785-219a-41bd-ae96-c4fc6f623f26 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:06.964317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422785-219a-41bd-ae96-c4fc6f623f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:07.029322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1d422785-219a-41bd-ae96-c4fc6f623f26 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:07.030567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d422785-219a-41bd-ae96-c4fc6f623f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:07.127391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 725/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:07.423225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:07.423512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:07.423791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:07.425148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 748/1473] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:07.430701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20692-0b1d-44e8-a811-ba989d8e4a4f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:07.430986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20692-0b1d-44e8-a811-ba989d8e4a4f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:07.431258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20692-0b1d-44e8-a811-ba989d8e4a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:07.506019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cbb20692-0b1d-44e8-a811-ba989d8e4a4f None None] MFA Rules not processed for user `9dab615c85bb4e50b46a69e92b33963e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:07.507260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cbb20692-0b1d-44e8-a811-ba989d8e4a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:07.531657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:07.587787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 726/1474] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:07.595632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:07.597130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:07.702111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eb293-190a-4373-b16c-a7407c144f15 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:07.775427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:07.776029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:07.776305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:07.776574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:07.778195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:07.832293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:07.886045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:07.887516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e63795-689a-4255-9404-edac56a25dbf service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:07.909330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 749/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:10.116376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:10.116887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:10.116887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:10.118785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 727/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:10.124145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c069d-1d95-4719-aead-e1fe7703270f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:10.124569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c069d-1d95-4719-aead-e1fe7703270f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:10.124680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c069d-1d95-4719-aead-e1fe7703270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:10.189472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-af4c069d-1d95-4719-aead-e1fe7703270f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:10.190723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af4c069d-1d95-4719-aead-e1fe7703270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:10.285049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 750/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:10.559152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:10.560700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:10.682387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58de6-443e-4d83-9467-dfd4c2c447d7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:10.730094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:10.774694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:10.775284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:10.775555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:10.775818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:10.776437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:10.778144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:02:10.778144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:02:10.778144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:02:10.779312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38258e-95d4-4ab6-bc84-d34f9fef7908 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:10.798062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 728/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 15:02:10 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:02:12.964223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:12.964787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:12.964787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:12.966121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 751/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:12.971606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affcb7-c0a5-4a54-8c9d-a1ac0e77997b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:12.972009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affcb7-c0a5-4a54-8c9d-a1ac0e77997b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:12.972146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affcb7-c0a5-4a54-8c9d-a1ac0e77997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:13.038087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b5affcb7-c0a5-4a54-8c9d-a1ac0e77997b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:13.039818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5affcb7-c0a5-4a54-8c9d-a1ac0e77997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:13.136197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 729/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:13.427050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:13.428885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:13.439155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:13.574398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d7c1-cd18-43cd-9c5f-a9601eb29a99 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:13.652411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:13.685687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:13.686216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:13.686519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:13.686787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:13.688374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:13.778118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:13.779730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d3e8-28df-4491-9690-8071b0af5d70 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:13.797703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 752/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:16.118085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:16.118651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:16.118651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:16.119908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 730/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:16.125207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca09da-64cf-44fd-a786-b28985a44c3d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:16.125609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca09da-64cf-44fd-a786-b28985a44c3d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:16.125739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca09da-64cf-44fd-a786-b28985a44c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:16.190362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bfca09da-64cf-44fd-a786-b28985a44c3d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:16.191551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bfca09da-64cf-44fd-a786-b28985a44c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:16.236808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:16.288780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 753/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:02:16.576520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:16.578071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:16.602121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:16.683055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dcadf-fc5d-4ba5-9a10-0fd0daaf3136 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:16.754599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:16.755196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:16.755477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:16.755742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:16.757325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:16.829733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:16.863901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:16.865321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f8af6-83ea-478f-98b6-9bc94d2b2c3d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:16.891765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 731/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:19.075451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:19.076032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:19.076032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:19.077387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 754/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:19.082780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f982-9c51-4084-a6e9-c6a6f28dfbfd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:19.083203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f982-9c51-4084-a6e9-c6a6f28dfbfd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:19.083334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f982-9c51-4084-a6e9-c6a6f28dfbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:19.148602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fa11f982-9c51-4084-a6e9-c6a6f28dfbfd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:19.149799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fa11f982-9c51-4084-a6e9-c6a6f28dfbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:19.244778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 732/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:19.533613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:19.535232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:19.637674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af4e6-d5a7-4230-87d3-6f421de4badc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:19.707773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:19.709250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:19.709898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:19.710400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:19.710715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:19.712632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:19.821534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:19.823007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6273d-e290-4ac8-b7ac-1b8afd3eadbd service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:19.841049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 755/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:22.076047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:22.076604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:22.076604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:22.077921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 733/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:22.083299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a36a4-27dd-4b07-9bd3-5d54d31ec3b6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:22.083716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a36a4-27dd-4b07-9bd3-5d54d31ec3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:22.083850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a36a4-27dd-4b07-9bd3-5d54d31ec3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:22.148963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-579a36a4-27dd-4b07-9bd3-5d54d31ec3b6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:22.150159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-579a36a4-27dd-4b07-9bd3-5d54d31ec3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:22.201270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:22.244382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 756/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:22.533532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:22.535089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:22.571221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:22.638491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7852de9-80bb-4f62-8260-afab063549b2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:22.711961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:22.712551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:22.712822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:22.713083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:22.714668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:22.792048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:22.821699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:22.823151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58b072-5b43-4580-aa3d-fa01fdb1facd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:22.841162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 734/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:25.192630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:25.193202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:25.193202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:25.194719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 757/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 15:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:02:25.200932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bf39-f2a4-4c36-ad42-302c4e69fbf5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:25.201475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bf39-f2a4-4c36-ad42-302c4e69fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:25.201596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bf39-f2a4-4c36-ad42-302c4e69fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:25.267268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a19bf39-f2a4-4c36-ad42-302c4e69fbf5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:02:25.268400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a19bf39-f2a4-4c36-ad42-302c4e69fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:25.365186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 735/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:02:25.661116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:02:25.662703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:25.765951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2024c4d-4f69-4987-be81-799115d09e03 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:02:25.838301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:02:25.838963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:02:25.839234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:02:25.839496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:02:25.841066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:02:25.849428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:25.948045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:02:25.949396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37bb7a-eacc-4d84-a06e-0a9ef767a64d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:02:25.967050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 758/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:02:35.363713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:02:35.964744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=50 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:45.274353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:45.274888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:45.274888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:45.349372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:03:45.350597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:45.445607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 736/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:03:45.453201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:45.453684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:45.453788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:45.528110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:03:45.529254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:45.623873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 759/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:03:45.628493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:45.629741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:45.640903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd67fb-9acc-4513-bae8-3f93d392e9c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:45.701257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:45.743377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:45.743981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:45.744290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:45.744602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:45.745262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:03:45.745569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:45.746605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:45.746605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:03:45.746605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:03:45.747481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:45.758755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 737/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:03:45.767059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:45.776378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308813d-3bec-4c57-913d-0fdc2fc9dd3e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:45.837065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:45.869689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:45.870321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:45.870602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:45.870870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:45.871484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:45.873215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:45.873215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:03:45.873215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:03:45.874427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:45.929437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 760/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:03:45 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:03:45.933656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:45.936641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:45.969753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39ded2-56ea-4d0a-bcd7-fa4cbaaf94be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:46.063810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:46.064435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.064708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.064972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.065587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:46.066612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:46.066612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:03:46.066612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:03:46.067847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:46.109463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 738/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:03:45 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:03:46.113511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:46.115992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.178832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacad8-a0a8-49c0-abda-d369ac048dd3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:46.260028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:46.270432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:46.271801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.272233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.272636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.273271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:46.274289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:46.274289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:03:46.274289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:03:46.275161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:46.287736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 761/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:03:46.291770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:46.293321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.304885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401589a-e021-489b-afb9-8bc0360aebea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:46.329618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:46.398851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:46.399458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.399737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.400007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.400639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:46.401644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:46.401644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:03:46.401644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:03:46.402552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcffcb8-3de5-403d-b933-4782af8bb6ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:46.415124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 739/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:03:46.419252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:46.420779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.453734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5e42-1849-4601-bf55-c70f4d9cd4ee admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:46.548598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:46.549259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.549539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.549813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] PATH_INFO: `/v3/projects/910c5f7e06034123b7bb063d02bf32f1/users/6f1106a7e71f4fe4bb2f8188cf7ebf47/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.572557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910c5f7e06034123b7bb063d02bf32f1, user_id=6f1106a7e71f4fe4bb2f8188cf7ebf47, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:46.573586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:46.573586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:03:46.573586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:03:46.575562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad723-078e-4cf5-8ee0-454dd9552552 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:46.599265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 762/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:03:46 2022] PUT /identity/v3/projects/910c5f7e06034123b7bb063d02bf32f1/users/6f1106a7e71f4fe4bb2f8188cf7ebf47/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:03:46.611592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef1c3-f19e-48cb-a918-b0b897754188 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.611882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef1c3-f19e-48cb-a918-b0b897754188 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.612161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef1c3-f19e-48cb-a918-b0b897754188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.669644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-192ef1c3-f19e-48cb-a918-b0b897754188 None None] MFA Rules not processed for user `6f1106a7e71f4fe4bb2f8188cf7ebf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:03:46.670805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-192ef1c3-f19e-48cb-a918-b0b897754188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.750069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 740/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:03:46.763192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.763480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.763758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.765106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 763/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 15:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:03:46.769825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317120ec-5685-4470-8f2e-dd20a4a397f0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:46.770109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317120ec-5685-4470-8f2e-dd20a4a397f0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:46.770414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317120ec-5685-4470-8f2e-dd20a4a397f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:46.801705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:46.844856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-317120ec-5685-4470-8f2e-dd20a4a397f0 None None] MFA Rules not processed for user `2ff83fd91f594d97af82492a1eb344af`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:03:46.846042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-317120ec-5685-4470-8f2e-dd20a4a397f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.919339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 741/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:03:46.927160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:46.928904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:46.980087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:47.033154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ae07-846a-46b7-beac-389b7d345d34 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:47.106088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:47.106719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:47.106994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:47.107263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:47.108854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:47.204001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:47.205349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:47.209375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:47.224639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 764/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:03:47.268285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c17c0-7caa-428e-abef-734a682936bd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:47.268571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c17c0-7caa-428e-abef-734a682936bd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:47.268842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c17c0-7caa-428e-abef-734a682936bd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:47.270086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 742/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sun Sep 11 15:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:03:47.274155 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:47.275383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:47.371725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130da66-bcef-4981-bdc3-cdf4b26ef408 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:47.462445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:47.463066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:47.463263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:47.463529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] PATH_INFO: `/v3/users/6f1106a7e71f4fe4bb2f8188cf7ebf47` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:47.476445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1106a7e71f4fe4bb2f8188cf7ebf47)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:47.477461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:47.477461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:03:47.477461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:03:47.478706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:47.488232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:47.547533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1106a7e71f4fe4bb2f8188cf7ebf47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:47.562492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1106a7e71f4fe4bb2f8188cf7ebf47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:47.584645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1106a7e71f4fe4bb2f8188cf7ebf47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:47.585214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1106a7e71f4fe4bb2f8188cf7ebf47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:47.585632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1106a7e71f4fe4bb2f8188cf7ebf47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:47.600432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 765/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:03:47 2022] DELETE /identity/v3/users/6f1106a7e71f4fe4bb2f8188cf7ebf47 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:03:47.604907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:47.605413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:47.605516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:47.661954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:03:47.663171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:47.738413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:47.750876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 743/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:03:47.760581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:47.761812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:47.860555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d177e-3178-4936-83fb-8f5e2e174fe1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:47.915996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:47.936783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:47.937392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:47.937666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:47.937939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:47.939543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:48.049584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:48.051004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499f54-bbfe-4ba1-a7cb-e9e62401c629 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:48.069240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 766/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:03:48.496755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:03:48.497996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:03:48.509852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530bf8e-a7dc-4959-8fe1-7a257bfccfda None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:03:48.611871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:03:48.612503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:03:48.612694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:03:48.612960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] PATH_INFO: `/v3/projects/910c5f7e06034123b7bb063d02bf32f1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:03:48.623315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=910c5f7e06034123b7bb063d02bf32f1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:03:48.624334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:03:48.624334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:03:48.624334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:03:48.625521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:03:48.684753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910c5f7e06034123b7bb063d02bf32f1', 'request_id': 'req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:48.695553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910c5f7e06034123b7bb063d02bf32f1', 'request_id': 'req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:48.701544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910c5f7e06034123b7bb063d02bf32f1', 'request_id': 'req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:48.730013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] The token cache is being invalidate because project 910c5f7e06034123b7bb063d02bf32f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:03:48.730320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:48.730834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6dde2fa1-419f-4996-8f8c-d8cb4d49a48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:03:48.732127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 744/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:03:48 2022] DELETE /identity/v3/projects/910c5f7e06034123b7bb063d02bf32f1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:03:58.066533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=62 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:03:58.728023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:19.784546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:19.785149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:19.785149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:19.786497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:19.791439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9a48-8411-4e70-9dfa-d9e85974a043 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:19.791864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9a48-8411-4e70-9dfa-d9e85974a043 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:19.792049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9a48-8411-4e70-9dfa-d9e85974a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:19.875642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cbff9a48-8411-4e70-9dfa-d9e85974a043 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:19.876763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cbff9a48-8411-4e70-9dfa-d9e85974a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:19.988744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:20.147032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:20.149114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:20.271240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491997da-4f1d-45b1-b4e6-d7d874a79046 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:20.276676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:20.277279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:20.277556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:20.277825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:20.286369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:20.287939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998aab5-5aff-4c9a-b598-327a1630733a service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:20.297144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 768/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:21.391130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf31d58-3e9a-433b-8c07-58d072ff580e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:21.391677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf31d58-3e9a-433b-8c07-58d072ff580e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:21.391677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf31d58-3e9a-433b-8c07-58d072ff580e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:21.393562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:21.399725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488a77-52e6-4bfc-bbc1-25162692132d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:21.400157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488a77-52e6-4bfc-bbc1-25162692132d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:21.400299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488a77-52e6-4bfc-bbc1-25162692132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:21.420017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35488a77-52e6-4bfc-bbc1-25162692132d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:21.421203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35488a77-52e6-4bfc-bbc1-25162692132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:21.429225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:21.598097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf31d58-3e9a-433b-8c07-58d072ff580e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:21.612928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf31d58-3e9a-433b-8c07-58d072ff580e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:21.618509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:21.619111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:21.619404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:21.619678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:21.628017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:21.629603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda7e62-6e87-4d43-a426-18b65e4936a4 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:21.638996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 747/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:21.887174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678178-3b61-4039-bb35-34c560cf2e94 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:21.888033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678178-3b61-4039-bb35-34c560cf2e94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:21.888317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678178-3b61-4039-bb35-34c560cf2e94 None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:21.889706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 770/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sun Sep 11 15:05:21 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:05:21.896158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be38-4b19-4e80-9f17-6e7101d6d3d0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:21.896577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be38-4b19-4e80-9f17-6e7101d6d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:21.897041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be38-4b19-4e80-9f17-6e7101d6d3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:21.961816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0110be38-4b19-4e80-9f17-6e7101d6d3d0 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:21.963051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0110be38-4b19-4e80-9f17-6e7101d6d3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:21.979915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:22.036000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 748/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:25.579053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee2a4-ae46-435a-bb6a-adbd3e1ae761 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:25.579614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee2a4-ae46-435a-bb6a-adbd3e1ae761 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:25.579614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee2a4-ae46-435a-bb6a-adbd3e1ae761 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:25.581024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 771/1519] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 15:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:25.585928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b983-ee19-4c8b-a15b-140394a364b3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:25.586367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b983-ee19-4c8b-a15b-140394a364b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:25.586591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b983-ee19-4c8b-a15b-140394a364b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:25.606228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d995b983-ee19-4c8b-a15b-140394a364b3 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:25.607494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d995b983-ee19-4c8b-a15b-140394a364b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:25.616463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 749/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:25.623892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ee2a4-ae46-435a-bb6a-adbd3e1ae761 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:25.636927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ee2a4-ae46-435a-bb6a-adbd3e1ae761 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:25.641974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:25.642600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:25.642873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:25.643134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:25.651240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:25.652795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb09c-b602-47f3-b34e-5e9fed7abaf6 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:25.662647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 772/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:33.102608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48511c9-853b-4e73-b7f3-9a301b99c156 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:33.103166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48511c9-853b-4e73-b7f3-9a301b99c156 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:33.103166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48511c9-853b-4e73-b7f3-9a301b99c156 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:33.104481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:05:33.110692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63daa-72a2-4d18-82b2-3f1052934c2c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:33.111134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63daa-72a2-4d18-82b2-3f1052934c2c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:33.111231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63daa-72a2-4d18-82b2-3f1052934c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:33.130873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-93b63daa-72a2-4d18-82b2-3f1052934c2c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:33.132051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-93b63daa-72a2-4d18-82b2-3f1052934c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:33.139812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:33.294675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48511c9-853b-4e73-b7f3-9a301b99c156 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:33.308960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48511c9-853b-4e73-b7f3-9a301b99c156 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:33.314401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:33.315499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:33.315774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:33.316043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:33.323888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:33.325440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5793cf-93c7-447a-aa12-db89ba185369 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:33.335047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 751/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:34.386787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a8c7-76b1-4376-ac1e-24462e4efdc3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:34.387306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a8c7-76b1-4376-ac1e-24462e4efdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:34.387306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a8c7-76b1-4376-ac1e-24462e4efdc3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:34.388633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 15:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:34.395325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e332f3-b737-4c14-863c-3a0efc95b2ab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:34.395767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e332f3-b737-4c14-863c-3a0efc95b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:34.395874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e332f3-b737-4c14-863c-3a0efc95b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:34.416381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7e332f3-b737-4c14-863c-3a0efc95b2ab None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:34.417574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7e332f3-b737-4c14-863c-3a0efc95b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:34.425393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:34.577907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8a8c7-76b1-4376-ac1e-24462e4efdc3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:34.592800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8a8c7-76b1-4376-ac1e-24462e4efdc3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:34.598181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:34.598801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:34.599079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:34.599348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:34.607226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:34.608820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe667e-2105-4ad2-8894-1663c0247078 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:34.617986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 775/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:38.624293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:38.624854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:38.624854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:38.626187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:38.632808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221385-3390-4dab-8453-61e20753537d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:38.633240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221385-3390-4dab-8453-61e20753537d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:38.633339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3221385-3390-4dab-8453-61e20753537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:38.653343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b3221385-3390-4dab-8453-61e20753537d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:38.654598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3221385-3390-4dab-8453-61e20753537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:38.662318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:38.950546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:38.952217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:39.029839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13564d8-5b30-457d-a393-312cfe8d685f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:39.033855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:39.034489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:39.034765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:39.035031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:39.043651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:39.045051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0426-438b-4f60-ae4b-bac2efcb0c34 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:39.055051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 754/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:41.212258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a5de-9cbb-4cce-b22d-bf9de4109cae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:41.212836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a5de-9cbb-4cce-b22d-bf9de4109cae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:41.212836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a5de-9cbb-4cce-b22d-bf9de4109cae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:41.214181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:41.219399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba20-957d-4265-8a34-e978a6c80f08 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:41.219799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba20-957d-4265-8a34-e978a6c80f08 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:41.219891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba20-957d-4265-8a34-e978a6c80f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:41.239706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-39adba20-957d-4265-8a34-e978a6c80f08 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:41.240909 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39adba20-957d-4265-8a34-e978a6c80f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:41.248812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:41.538449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2a5de-9cbb-4cce-b22d-bf9de4109cae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:41.551690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2a5de-9cbb-4cce-b22d-bf9de4109cae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:41.555566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:41.556166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:41.556442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:41.556716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:41.565828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:41.567286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c289ef8-5296-4ee4-b086-5ca7e1f1f8f1 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:41.576607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 778/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:45.242198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:45.242703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:45.242703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:45.244034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:45.249261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546455a4-43ac-4556-8922-7d31730ab37a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:45.249708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546455a4-43ac-4556-8922-7d31730ab37a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:45.249806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546455a4-43ac-4556-8922-7d31730ab37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:45.269974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-546455a4-43ac-4556-8922-7d31730ab37a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:45.271190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-546455a4-43ac-4556-8922-7d31730ab37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:45.278952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:45.587888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:45.589553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:45.652855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:45.665908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba0242-46fa-4ed0-a36c-7eed02791a99 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:45.669451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:45.670044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:45.670358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:45.670632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:45.680064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:45.681480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43967f-7147-4209-b0b9-18c97c1e7805 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:45.691222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 757/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:47.818791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:47.819367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:47.819367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:47.820710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 15:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:05:47.826015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4aa8f-8c57-4293-9c37-a11de93b5ff3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:47.826481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4aa8f-8c57-4293-9c37-a11de93b5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:47.826594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4aa8f-8c57-4293-9c37-a11de93b5ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:47.846508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8bc4aa8f-8c57-4293-9c37-a11de93b5ff3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:05:47.847682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8bc4aa8f-8c57-4293-9c37-a11de93b5ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:47.855326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:05:48.153371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:05:48.155169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:05:48.162678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:48.168803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ab81-2e2a-469b-8bea-4e025fad748b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:05:48.172245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:05:48.172832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:05:48.173105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:05:48.173375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:05:48.182325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:05:48.183745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdff71b-492b-4dbe-8833-5e0a828d526f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:05:48.193304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 781/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:05:57.841142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=11 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:05:58.188812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:14.109862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.111054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.111054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.136952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.138146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.150974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 759/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:14.159640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.160178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.160178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.189797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.191037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.209463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 782/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.213654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.224423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ae1cd-4c53-4f72-b908-d300d24f5eb1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.235455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.236000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.236274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.236544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.237189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.237490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.239113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d656-1277-4ab1-a266-4f174c2b95b7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.267574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 760/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.275774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.292567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5857b-a5a9-4f35-8a24-3dd2858f41f0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.302150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.302803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.303082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.303353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.303989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.306171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8ba7-574e-4e00-ba27-3d18208475a2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.308939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7602bbe-9445-4343-a64a-ab67599158ea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.309224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7602bbe-9445-4343-a64a-ab67599158ea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.309497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7602bbe-9445-4343-a64a-ab67599158ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.341381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7602bbe-9445-4343-a64a-ab67599158ea None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.342624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7602bbe-9445-4343-a64a-ab67599158ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.358891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 761/1543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:14.360396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.360683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.360953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.365060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 783/1544] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:14.366627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056940-766c-4d47-9090-40983127f1d6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.367140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056940-766c-4d47-9090-40983127f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.367634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056940-766c-4d47-9090-40983127f1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.395506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.397130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.403873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77056940-766c-4d47-9090-40983127f1d6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.405523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77056940-766c-4d47-9090-40983127f1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.478048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 762/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.478979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.489746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d350-e923-455b-8f1d-493743c8693f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.494194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.494824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.495100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.495368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.495737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 784/1546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.496000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.497042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91748-4623-4bae-a19d-6cef7bb7a150 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.497336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91748-4623-4bae-a19d-6cef7bb7a150 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.497613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91748-4623-4bae-a19d-6cef7bb7a150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.497885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48459e-3d98-49fb-9466-fa3f283a3b76 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.518796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-69a91748-4623-4bae-a19d-6cef7bb7a150 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.519999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-69a91748-4623-4bae-a19d-6cef7bb7a150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.520354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 763/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:14.523431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a84d-d29c-4d05-801e-3884f7b60a9a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.523431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a84d-d29c-4d05-801e-3884f7b60a9a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.523431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a84d-d29c-4d05-801e-3884f7b60a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.527977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 785/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.529166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd999-5d7c-4be9-a06f-f55af3a8d7dc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.529443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd999-5d7c-4be9-a06f-f55af3a8d7dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.529715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd999-5d7c-4be9-a06f-f55af3a8d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.541746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-aba3a84d-d29c-4d05-801e-3884f7b60a9a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.542972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aba3a84d-d29c-4d05-801e-3884f7b60a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.549433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-26acd999-5d7c-4be9-a06f-f55af3a8d7dc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.550630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26acd999-5d7c-4be9-a06f-f55af3a8d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.553139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 764/1549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.555032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b89ab-ed68-417a-80af-af61f02caadd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.555387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b89ab-ed68-417a-80af-af61f02caadd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.555665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b89ab-ed68-417a-80af-af61f02caadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.562002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 786/1550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.563905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1993a-c267-459c-b56f-0881b2710464 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.564186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1993a-c267-459c-b56f-0881b2710464 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.564455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1993a-c267-459c-b56f-0881b2710464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.583380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bf9b89ab-ed68-417a-80af-af61f02caadd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.584908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf9b89ab-ed68-417a-80af-af61f02caadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.587124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-37a1993a-c267-459c-b56f-0881b2710464 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.588230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37a1993a-c267-459c-b56f-0881b2710464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.593179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 765/1551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.594397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.594680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.594951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.601840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 787/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.603153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.603434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.603728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.618434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.619667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.623404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.624549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.628246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 766/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.629006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.637071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 788/1554] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.637846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.638298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823dd1-f64b-4c3d-b226-7f597cc569d0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.642941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.643520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.643794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.644059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.644688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.646259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ea240-8549-47ba-8dbe-619db580cd1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.647147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1ea07-cc02-43f9-9448-7e9b6d59dd14 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.652627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.653326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.653673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.654013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.654758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.655133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.656119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 767/1555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:14.656310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:14.656310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:07:14.656310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:07:14.657273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea440e3-6fe0-4aa7-b080-a51a3ed08f5e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.657550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea440e3-6fe0-4aa7-b080-a51a3ed08f5e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.657671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f7e76-96c3-4629-a607-5fc43bd92c27 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.657811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea440e3-6fe0-4aa7-b080-a51a3ed08f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.669789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 789/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.671004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3bfa-3549-4d18-9fd7-3570e3753414 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.671287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3bfa-3549-4d18-9fd7-3570e3753414 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.671555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3bfa-3549-4d18-9fd7-3570e3753414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.677852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6ea440e3-6fe0-4aa7-b080-a51a3ed08f5e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.679456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ea440e3-6fe0-4aa7-b080-a51a3ed08f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.687193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 768/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.688911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.689228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.689496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.697089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-011d3bfa-3549-4d18-9fd7-3570e3753414 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.698302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-011d3bfa-3549-4d18-9fd7-3570e3753414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.706243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 790/1558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.707325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.707606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.707870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.708526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.709698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.717480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 769/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.718118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.727106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92acca9-409e-4989-8141-0d7fe7181978 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.727516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:14.728701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:14.731592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.732168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.732444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.732713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.733333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.733629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.735746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.737241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 791/1560] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:14.738004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.748032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8fdc-49c0-4a3a-8906-2ef2302b841f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.750349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 770/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.751825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.753199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.753843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.754125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.754433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.755074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.755376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.756985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.762995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c379d2-8fe6-4c85-8da6-a517ae7b22c4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.767687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.768411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.768694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.768969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.769631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.771309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.774424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 792/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.775256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.784665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 771/1563] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:14.784665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.785072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f2a9-0d6b-469f-b0b9-bed0291d6cf9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.789562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.790151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.790460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.790732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.791342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.792122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1d4b-9d2f-43cb-bb5c-c203e785f1f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.793261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.796615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.797183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.797958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.798234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.798905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.799201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.800752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.813073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 772/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.814162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.824941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 793/1565] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:14.825961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f621d-30d8-4e58-8b8d-884fcd4d77e0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.826125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.862256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:14.865330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:14.887859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5f4f2-01ce-4f6b-9615-8724c7a11406 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.888359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.888968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.889246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.889517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.890151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.890487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.892608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.893023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.893622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.893893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.894161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.894825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.895126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.896705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.904204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 773/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.904204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.915107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723951-248d-49f4-9fdb-e43463eb547d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.922439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 794/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.922439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.923966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.924556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.924831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.925124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.925748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:14.926049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.927708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.929670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d0f8e-6d9d-4e55-848f-e6008a031436 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.934531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.935116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.935393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.935663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.936303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.938215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.939748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 774/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:14.940549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.951605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453b1fa-08f9-4281-8ef3-b5a3f7d96a42 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:14.956994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:14.957654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:14.957990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:14.958399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:14.959323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:14.960344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:14.960344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:07:14.960344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:07:14.961575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:14.971268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 795/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:14.971268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:14.989610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 775/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:14.990537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.033663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd679218-cfde-4bc6-af27-cb2d37d96c32 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.050580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738ee5-e193-4a05-9602-56432c3cc21b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.055442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.056036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.056316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.056583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.057203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.059120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.088436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 776/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:14 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.089271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.096034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.096697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.096972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.097265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] PATH_INFO: `/v3/projects/357c8b55be4043e299604dd95a5fbbda/users/b2448cf60e65455a948b557a4ba13d1b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.116049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357c8b55be4043e299604dd95a5fbbda, user_id=b2448cf60e65455a948b557a4ba13d1b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.118869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.132506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 796/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:14 2022] PUT /identity/v3/projects/357c8b55be4043e299604dd95a5fbbda/users/b2448cf60e65455a948b557a4ba13d1b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:15.142583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.151875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec74de-3a0e-4a01-8f0a-83c1ecb78d1d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.179752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.185114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.208656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b490-05a6-414a-9085-0275f2ae5360 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.213234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.213843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.214062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.214216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.214482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.214692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.214967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.215109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.215218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.215838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.217054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.217721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.241932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 777/1573] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.244379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.255074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 797/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.256041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a529-f6dc-4b4d-8c40-3c75278411be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.256188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.321683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.322228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.322541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.322798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.323419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.324540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4fdee-412b-4941-870e-0636e88168ca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.325299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.329459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.330063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.330770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.330910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.331414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.333306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.353002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 778/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.354184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.363049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 798/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.364067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.416982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0290-dbf0-442c-aa60-ecbc33ebc4d3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.427369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070cd4-5c53-4e36-83a0-d6a4c0fcf9eb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.432590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.433194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.433900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.434181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.434844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.435863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:15.435863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:07:15.435863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:07:15.437078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.459077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 799/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.460256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.465082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.471239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bda44-5370-4326-b013-68ce1ef1e9c6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.476169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.476756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.477044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.477356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.477973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.478767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.479372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.479646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.479909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2594-6026-4f8f-8c43-d548c6e15cad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.480005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.480525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.482426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.501986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 800/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.503270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.503547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.503817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.507302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 779/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.507302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.515429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8ad1-62d9-411f-af28-cf6a46f3120e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.520669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.521282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.521559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.521827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.522487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.524176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.533586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] MFA Rules not processed for user `b2448cf60e65455a948b557a4ba13d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:15.534657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 780/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.534883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:15.535433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.543740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.544601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473bf7-573d-4934-b127-8df8fb722484 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.549963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.550579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.550858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.551131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.551748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.553635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.574938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 781/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.575846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.585934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c5b03-b3c7-4d77-a764-27af4c511d70 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.590488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.591064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.591341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.591610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.592222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.594097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.605400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 801/1582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:15.606255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.616675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1553bd1-854d-4330-997d-51a6eb407ef1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.623615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 782/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.623776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.623920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.624017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.624017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.624017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.624017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.625116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.632580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cc8ad-8e03-4898-b5c8-81bc7ce5abfe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.640101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.640889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.641767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.642146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.643180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.646049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.652899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 802/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/users => generated 282 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:15.653900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.659941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 783/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.660652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.665116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd4304-9048-40d5-ae52-1ac8abe2c5a5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.669927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.670569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.670854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.671125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.671318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d5c0-699a-4d3d-9c4e-16795edf4b52 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.671761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.673380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.676217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.676815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.677091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.677368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.678000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.679882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.684211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 803/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.684996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.693484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 784/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.693484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.696725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35ec6-2fc8-448e-92e3-545b8d162b56 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.700755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1a21b-d544-47c0-9ead-7dbb50ef3251 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.701229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.701808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.702079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.702375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.703010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.705097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.706322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.706896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.707181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.707452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.708086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.709611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2149cb-d6f4-4a4d-8ae7-d33a9e1ed69e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.715064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 804/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.715900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.720410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 785/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.721657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b98dd-e6d2-42e5-9c88-cda795025036 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.721941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b98dd-e6d2-42e5-9c88-cda795025036 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.722210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b98dd-e6d2-42e5-9c88-cda795025036 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.723552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 786/1590] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 15:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:15.724295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b98dd-e6d2-42e5-9c88-cda795025036 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.731294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27e0e-79b7-41f9-a3af-2d4a911c0f5e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.735857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.736223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b98dd-e6d2-42e5-9c88-cda795025036 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.736440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.737369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.737644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.738295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.739876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.740609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.741158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.741432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.741699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.742339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.743879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.749868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 805/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.751219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.756684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 787/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.757731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.760617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b9fa1-19a0-40c9-a54a-cb28c6d921bf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.765974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.767421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.767702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.767973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.768603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.769399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e66ea-2621-444f-8335-a16f8485ae09 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.770177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.774104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.774757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.775037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.775314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.775942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.777531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.780831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 806/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.781605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.792011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 788/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.792011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.792251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4331a69-b6b7-48f5-ab2c-77f1aad28d78 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.796326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.796929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.797527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.797800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.798461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.799412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89722cc-a802-4b45-925f-66ee684acd81 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.800027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.804363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.805022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.805303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.805576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] PATH_INFO: `/v3/projects/ee3b6870ab68482f8d3774918c83c850/users/fea2726e2fad4a499543726fa80b627d/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.810183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 807/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.811040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.821034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3b6870ab68482f8d3774918c83c850, user_id=fea2726e2fad4a499543726fa80b627d, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.821185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce962b4-087e-4cc0-b7e2-fa6142b68f9b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.822318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:15.822318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:07:15.822318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:07:15.824244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401aa5-f4f0-4378-8726-c168ba8d84d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.825762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.826290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.826583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.826852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.827475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.829921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.837882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 789/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:15 2022] PUT /identity/v3/projects/ee3b6870ab68482f8d3774918c83c850/users/fea2726e2fad4a499543726fa80b627d/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:15.839380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.839662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.839932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.843509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 808/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.843509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.853266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645593-13a5-4e55-8533-84daee37ca4d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.881522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:15.882808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:15.909796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.910453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.910730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.911006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.911636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.913220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.922657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 809/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.923529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.933414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7f1d-bbca-48be-b77c-8dad330a13fc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.936862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.938729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.939266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.939551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.939798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.940409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.941957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.952263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 810/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:15.953078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.955616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 790/1600] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:15.959128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:15.963751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8fd64-1a71-43d3-abf2-ea6226539ac6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.968403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.969032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.969225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4d86-9517-43fc-9584-6478ecbeff38 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:15.969361 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.969602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] PATH_INFO: `/v3/projects/809d97a61e7540ab90585eaf42835ba6/users/11ad6f5f60af4f9ebc73aab606c8a15f/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.977760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:15.981800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:15.982495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:15.982594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:15.982594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] PATH_INFO: `/v3/projects/96b6113de88048e78409b9b608e38b5a/users/4731961874e54d8a9f79f207572908aa/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:15.985703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809d97a61e7540ab90585eaf42835ba6, user_id=11ad6f5f60af4f9ebc73aab606c8a15f, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.988689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:15.995039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b6113de88048e78409b9b608e38b5a, user_id=4731961874e54d8a9f79f207572908aa, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:15.997658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.002459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 811/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:15 2022] PUT /identity/v3/projects/809d97a61e7540ab90585eaf42835ba6/users/11ad6f5f60af4f9ebc73aab606c8a15f/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.003337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.011312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 791/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:15 2022] PUT /identity/v3/projects/96b6113de88048e78409b9b608e38b5a/users/4731961874e54d8a9f79f207572908aa/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.012335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.067508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431b447-86a1-463a-b07f-b782bd9d9af3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.072235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.072895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.073179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.073452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] PATH_INFO: `/v3/projects/c973f25451bc4792905503cbd1b6f974/users/0ebfb0c90f2e4b219012916ad2f9b071/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.074658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe19a5-1287-42ba-a87d-dd93bbbbfc84 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.079939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.080537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.080818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.081094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] PATH_INFO: `/v3/projects/2db644e1d9d3454ba6b485a476c71d16/users/e86084bfaba0451e8a3feeb5a123359b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.088183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c973f25451bc4792905503cbd1b6f974, user_id=0ebfb0c90f2e4b219012916ad2f9b071, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.090883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26ca01-bc88-4028-8ac9-a344560619e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.096901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db644e1d9d3454ba6b485a476c71d16, user_id=e86084bfaba0451e8a3feeb5a123359b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.100099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.105515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 812/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:16 2022] PUT /identity/v3/projects/c973f25451bc4792905503cbd1b6f974/users/0ebfb0c90f2e4b219012916ad2f9b071/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.106651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.106990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.107340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.113595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 792/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:16 2022] PUT /identity/v3/projects/2db644e1d9d3454ba6b485a476c71d16/users/e86084bfaba0451e8a3feeb5a123359b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.114404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.138126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] MFA Rules not processed for user `fea2726e2fad4a499543726fa80b627d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.139365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.177046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65b6a-aa1b-43d1-987c-db5c58db394d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.182876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.183540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.183987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.184288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] PATH_INFO: `/v3/projects/97a4039274194c9794738870515ef983/users/9bf031090a79480291873a34ce703e64/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.200078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a4039274194c9794738870515ef983, user_id=9bf031090a79480291873a34ce703e64, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.202763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.203969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 813/1605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.204908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.216979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556299ee-243d-4d89-b2b2-578f3aba15ae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.220875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 793/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:16 2022] PUT /identity/v3/projects/97a4039274194c9794738870515ef983/users/9bf031090a79480291873a34ce703e64/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.220875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.261991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:16.283321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.284007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.284282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.284584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] PATH_INFO: `/v3/projects/1a08c237b1304b6d9113cfe736078e4c/users/259b54d1c746470c987a9bcbcd6520ee/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.286850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:16.300403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a08c237b1304b6d9113cfe736078e4c, user_id=259b54d1c746470c987a9bcbcd6520ee, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.300777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ecb8-47f5-4bca-9256-93ef84a06218 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.303093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199f67-b675-492b-b45a-e88d3608f654 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.306627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.307184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.307582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.307848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.316996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 814/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:16 2022] PUT /identity/v3/projects/1a08c237b1304b6d9113cfe736078e4c/users/259b54d1c746470c987a9bcbcd6520ee/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:16.318779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203277-4caf-4781-991c-fa5dd190df25 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.318779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203277-4caf-4781-991c-fa5dd190df25 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.319045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203277-4caf-4781-991c-fa5dd190df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.338212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b5203277-4caf-4781-991c-fa5dd190df25 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.339427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5203277-4caf-4781-991c-fa5dd190df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.368996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.371607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cce2e-62b2-4358-8bf7-631d7c910f74 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.387829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 794/1608] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:16.389832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabc7e-6d31-4a48-941b-77484a46050e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.390384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabc7e-6d31-4a48-941b-77484a46050e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.390892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabc7e-6d31-4a48-941b-77484a46050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.402788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 815/1609] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.405602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1096b-df5b-402f-91fa-42e1ac6c0a9c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.406041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1096b-df5b-402f-91fa-42e1ac6c0a9c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.407254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1096b-df5b-402f-91fa-42e1ac6c0a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.410897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9eeabc7e-6d31-4a48-941b-77484a46050e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.412101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9eeabc7e-6d31-4a48-941b-77484a46050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.420005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 795/1610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.424796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.425123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.425417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.429075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-01c1096b-df5b-402f-91fa-42e1ac6c0a9c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.430764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01c1096b-df5b-402f-91fa-42e1ac6c0a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.439471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 816/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.443519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc842b-2036-4321-a5c0-134e309ab70a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.443800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc842b-2036-4321-a5c0-134e309ab70a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.444072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc842b-2036-4321-a5c0-134e309ab70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.456421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] MFA Rules not processed for user `e86084bfaba0451e8a3feeb5a123359b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.457751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.465312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7cbc842b-2036-4321-a5c0-134e309ab70a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.466679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7cbc842b-2036-4321-a5c0-134e309ab70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.476428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 817/1612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.478483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6060-4124-4ae6-9f3f-f73908df1ee5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.478909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6060-4124-4ae6-9f3f-f73908df1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.482625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6060-4124-4ae6-9f3f-f73908df1ee5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.484567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 818/1613] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 15:07:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:16.486740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.487307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.487755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.518753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] MFA Rules not processed for user `259b54d1c746470c987a9bcbcd6520ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.519969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.526394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 796/1614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.528459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.530300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.590827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ace98-badc-4936-a269-bf7ad28c6610 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.594890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.595491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.595775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.596047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.597417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 819/1615] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.598512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.605921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:16.608305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248adc7d-1b54-48ac-aea8-78ae92014e89 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.608846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.610966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.612338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.612964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.613213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.613484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.622485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 797/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:16.623469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.626848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.628794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e136c-1c71-40cf-afdf-ca624b28cd55 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.633208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19ac8-72c4-450a-b6be-7758d5f46629 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.638247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.638994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.639378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.639754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.644814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 820/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:16.644814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.644814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.644814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.669072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:16.670466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:16.683409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.687426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.713811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 798/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:16.714899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.723833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600855f-af0f-47c0-b106-02be68859b2e service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.728807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.730435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.730893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.731322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.731626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:16.749942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.753134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.772837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 799/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:16.773741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.778851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 821/1620] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:16.780143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.797134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef0832-d145-420a-b424-79e6c5a9b5af None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.803701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.806230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.806786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.807098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0dbcc-5bda-461c-acb4-6e2b148616aa service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.809407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.810736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.813794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.814449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.814995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.815111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.815743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.816289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.817571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de71f-1418-449c-a56c-68fa89dd5478 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.857495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 800/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:16.859412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d4632-daf2-4f67-ba2a-2b1181014769 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.859697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d4632-daf2-4f67-ba2a-2b1181014769 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.860897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d4632-daf2-4f67-ba2a-2b1181014769 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.868381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 801/1622] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 15:07:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:16.869658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d4632-daf2-4f67-ba2a-2b1181014769 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.875611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 822/1623] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:16.875611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:16.965380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80cff-bba7-40af-ade3-efb4a543b34b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.977165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.977846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.978129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.978444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:16.982670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:16.986809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8294-7a6b-42e1-8237-27b65cde2402 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:16.991085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d4632-daf2-4f67-ba2a-2b1181014769 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:16.997591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:16.998276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:16.998971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:16.999256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.028249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 823/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:16 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:17.031528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.031782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.032948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.065522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:17.066911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:17.087352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 824/1625] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:17.088945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.106176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6834d-65de-4edb-87a7-df875e7eb07d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.110539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.112712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.113177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.114046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.114668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.115141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.115999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.118198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.124199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 802/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:17.125264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.142174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a31d-2fa8-4c69-a54c-218f20af3680 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.147312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 825/1627] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:17 2022] POST /identity/v3/users => generated 288 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:17.150472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.154385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.157850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.158157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.158462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.162067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.163264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.202767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 803/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:17.204617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.222955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992330a-b65f-4c4f-9773-e2207c658cdc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.232451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.233126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.233461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.233800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.234797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.238749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.260865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 804/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:17.262108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.273174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a58ff-efd1-491d-b5fd-8b3722c7a2ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.280225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a8de-f5f5-46ca-beae-885531b9c8b5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.285835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.286485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.286774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.287045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.287301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.288840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.289429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.289858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] PATH_INFO: `/v3/projects/46e3281b75a54aba9e6aa22d226652fa/users/a9d31cae457a43cf9a2f305fdd0c4842/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.310568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.312041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.332116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 826/1630] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:17.340534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.341183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e3281b75a54aba9e6aa22d226652fa, user_id=a9d31cae457a43cf9a2f305fdd0c4842, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.344898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.364592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:17.365878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060ed6a-6292-45ee-b52f-0b633352de72 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.387881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 805/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:17 2022] PUT /identity/v3/projects/46e3281b75a54aba9e6aa22d226652fa/users/a9d31cae457a43cf9a2f305fdd0c4842/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:17.391894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.408541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:17.487595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.488276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.488555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.488923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] PATH_INFO: `/v3/projects/c35592de335c4fa8b0416f8990e13d92/users/ad2110182c9048cab9a8878d6cd9b9f7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.518423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35592de335c4fa8b0416f8990e13d92, user_id=ad2110182c9048cab9a8878d6cd9b9f7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.521129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.546473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 827/1632] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:17 2022] PUT /identity/v3/projects/c35592de335c4fa8b0416f8990e13d92/users/ad2110182c9048cab9a8878d6cd9b9f7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:17.551170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.616251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73cbf5-de7b-4efd-86aa-c9338fcbfd8a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.677872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe2d3-9a6c-409e-bd70-9390eb9f3277 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.689119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.689872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.690053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.690355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.691010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.692617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.722544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 828/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:07:17.726258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:17.739506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b55b9-8496-4721-bcf3-e082d2011216 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:17.749677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.751451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.751736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.752012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] PATH_INFO: `/v3/projects/c35592de335c4fa8b0416f8990e13d92/users/ad2110182c9048cab9a8878d6cd9b9f7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.757176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35592de335c4fa8b0416f8990e13d92, user_id=ad2110182c9048cab9a8878d6cd9b9f7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.764598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e9ff4-4b20-4261-83e0-00c334666ff0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.793439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 829/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:17 2022] PUT /identity/v3/projects/c35592de335c4fa8b0416f8990e13d92/users/ad2110182c9048cab9a8878d6cd9b9f7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:07:17.794858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79125-de1b-40cf-9fc9-ebd99260dfe1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.795144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79125-de1b-40cf-9fc9-ebd99260dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.795418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79125-de1b-40cf-9fc9-ebd99260dfe1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.796855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 830/1635] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 15:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:17.802659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:17.803345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.803692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.803970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.804879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:17.808033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.809475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.809766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.812063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d6ba-32bb-47b6-8159-af280254ea14 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:17.830080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 806/1636] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:17.832812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:17.833322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:17.833796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:17.870379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:17.872100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:17.909377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] MFA Rules not processed for user `ad2110182c9048cab9a8878d6cd9b9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:17.913277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:18.023819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 807/1637] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:18.032314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.109482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:18.120294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 831/1638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:18.121801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.165272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8ceb9-6f80-4cf3-be44-d3aae68dc370 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:18.174114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:18.174845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.175530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.175816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] PATH_INFO: `/v3/projects/46e3281b75a54aba9e6aa22d226652fa/users/a9d31cae457a43cf9a2f305fdd0c4842/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.179674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e3281b75a54aba9e6aa22d226652fa, user_id=a9d31cae457a43cf9a2f305fdd0c4842, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:18.184337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:18.186452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:18.212210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 808/1639] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:18 2022] PUT /identity/v3/projects/46e3281b75a54aba9e6aa22d226652fa/users/a9d31cae457a43cf9a2f305fdd0c4842/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:18.213659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.303802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e001-52f1-416a-bb94-8987e8f98f94 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:18.350927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a685-ef5a-4b2c-8f3d-2cc9dedd4165 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:18.362070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:18.364135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.365430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.365430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.443543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:18.444445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.444931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.445305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] PATH_INFO: `/v3/users/b2448cf60e65455a948b557a4ba13d1b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.447553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2448cf60e65455a948b557a4ba13d1b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:18.452776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:18.513279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:18.515465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:18.537154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 809/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:18.538320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.559819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2448cf60e65455a948b557a4ba13d1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:18.566712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85bbb-8e6c-4b07-bc82-53ad7d088317 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:18.576758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:18.577857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.578430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.578967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.580718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2448cf60e65455a948b557a4ba13d1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:18.610769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2448cf60e65455a948b557a4ba13d1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:18.611520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2448cf60e65455a948b557a4ba13d1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:18.612204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b4f75a2c-ca3a-4e55-82d6-29820c7054ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2448cf60e65455a948b557a4ba13d1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:18.639469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 832/1641] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:18 2022] DELETE /identity/v3/users/b2448cf60e65455a948b557a4ba13d1b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:18.639469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.639469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.639469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.704043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] MFA Rules not processed for user `a9d31cae457a43cf9a2f305fdd0c4842`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:18.705258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:18.728709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:18.730451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957b8b-212e-4460-9190-6573be6fca5b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:18.759440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 810/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:18.760926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:18.761141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:18.761331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:18.781342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:18.782593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:18.818659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:18.820084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:18.852576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 833/1643] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:18.921759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 811/1644] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:18.941144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.942702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:18.982457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:18.986122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:19.114505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f80fa-e539-4fae-aafe-0592a5d0db16 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:19.122251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180f95d-ef0f-4600-b349-bc22605d801a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:19.127957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:19.128725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:19.129001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:19.129368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:19.131356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:19.132304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:19.132637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:19.133403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:19.146546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:19.148699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:19.155580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:19.157702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:19.165786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 834/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:19.171262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 812/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:19.227662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:19.243298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbe0d-4021-4a4b-ba99-32e2ccbb9066 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:19.257519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:19.258817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:19.258990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:19.259292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:19.263928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:19.382442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:19.385188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:19.398588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 835/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:19.554489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:19.559084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:19.593233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947a99-ca16-4fc0-912f-53939ede07bb service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:19.597222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:19.597920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:19.598315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:19.598666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:19.611444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:19.734604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:19.739815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926ad3-af5b-4cf9-8f02-1e99999251fe service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:19.782805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 813/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:20.620943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:20.623151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:20.642506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fddd-6075-42c7-a22a-199b0bb9256c service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:20.647844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:20.648727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:20.649243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:20.649737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] PATH_INFO: `/v3/projects/357c8b55be4043e299604dd95a5fbbda` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:20.651406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357c8b55be4043e299604dd95a5fbbda)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:20.652635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:20.652635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 11 15:07:20.652635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: Sep 11 15:07:20.654249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:20.730730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357c8b55be4043e299604dd95a5fbbda', 'request_id': 'req-4c8e935d-6a30-4f03-a9fe-8889a1566e35'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:20.740691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357c8b55be4043e299604dd95a5fbbda', 'request_id': 'req-4c8e935d-6a30-4f03-a9fe-8889a1566e35'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:20.759765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357c8b55be4043e299604dd95a5fbbda', 'request_id': 'req-4c8e935d-6a30-4f03-a9fe-8889a1566e35'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:20.762955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:20.779590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] The token cache is being invalidate because project 357c8b55be4043e299604dd95a5fbbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:20.780228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:20.781419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c8e935d-6a30-4f03-a9fe-8889a1566e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:20.784433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 836/1649] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:20 2022] DELETE /identity/v3/projects/357c8b55be4043e299604dd95a5fbbda => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:20.789377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:20.789898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:20.790256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:20.817643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:20.819205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:20.896386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:20.941625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 814/1650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:20.949849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:20.950304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:20.950689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.005359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:21.007908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:21.031857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 837/1651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:21.040516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.050158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3c51-fe79-40c6-a802-d7d420f2a397 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.065395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.066120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.066492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.066832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.067555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:21.067924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.072332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.101830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 815/1652] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:21.103515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.115556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616c24-1f06-4dc8-b000-4136acc81e4b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.127323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.128256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.128659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.129227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.130904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.134475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.192839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 838/1653] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:21 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:21.196723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.213517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3365-6678-4e9f-ab2d-c537c2a25de9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.371471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.373210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.373493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.373765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.376538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.383751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.437291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 816/1654] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:21 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:21.439345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.464943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5447eb1-f867-4e0b-851d-ffd3be69d858 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.473788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.476578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.478247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.478764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.479993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.482808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.512925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 839/1655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:21.513946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.530474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb9cf9-0944-4f0e-a500-a3001cc31dd2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.542404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.543423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.543706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.544025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.546816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.551087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0825a-9b71-49a7-85be-db66fe9fc1cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.578415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 817/1656] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:21.583168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:21.595554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90565f4-6882-4346-ab62-e9c7ea9269bc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:21.614311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:21.614795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.615063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.617601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] PATH_INFO: `/v3/projects/9783519e8bd84ed09836434f1e9d42a4/users/c626e1e0b03d4e93a0afb6a092a3ceee/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.671104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9783519e8bd84ed09836434f1e9d42a4, user_id=c626e1e0b03d4e93a0afb6a092a3ceee, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:21.674027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:21.712059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 840/1657] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:21 2022] PUT /identity/v3/projects/9783519e8bd84ed09836434f1e9d42a4/users/c626e1e0b03d4e93a0afb6a092a3ceee/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:21.726920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:21.727476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:21.729431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:21.813864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] MFA Rules not processed for user `c626e1e0b03d4e93a0afb6a092a3ceee`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:21.815829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:21.902336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 818/1658] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:21.907500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.147333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85621f2-0aaf-4be7-8958-888b835aa5cc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:22.165614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:22.168391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.168701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.168981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.174861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:22.184119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:22.286830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 841/1659] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:21 2022] POST /identity/v3/projects => generated 379 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:22.297724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.319812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15e726-43b2-4016-9101-b9f25c75240f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:22.448699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:22.524690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:22.525457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.525738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.526009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.526717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:22.528635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:22.576278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.581274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:22.600448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 819/1660] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:22 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:22.601350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.608569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf014a2-c7c8-4a03-a737-6b855af800b0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:22.619617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:22.620553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.620965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.621462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] PATH_INFO: `/v3/users/fea2726e2fad4a499543726fa80b627d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.623071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea2726e2fad4a499543726fa80b627d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:22.627397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:22.631033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1679-753b-427b-bc11-3aa8ae9ed0b0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:22.653612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:22.654242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.654549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.654826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.655470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:22.661682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:22.694125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 820/1661] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:22.697887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.707895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea2726e2fad4a499543726fa80b627d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:22.719836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea2726e2fad4a499543726fa80b627d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:22.724870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff1c8-52f7-44bd-afd8-116cb2581a44 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:22.729505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:22.739484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:22.739638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea2726e2fad4a499543726fa80b627d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:22.740210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.740492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.740584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea2726e2fad4a499543726fa80b627d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:22.740773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] PATH_INFO: `/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915/users/2e4117be18ad4e098d28005b07effc21/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.742190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2d1a5c2d-a59c-49e8-b332-8d9b16d851f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea2726e2fad4a499543726fa80b627d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:22.762863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 842/1662] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:22 2022] DELETE /identity/v3/users/fea2726e2fad4a499543726fa80b627d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:07:22.767532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:22.768471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:22.769464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:22.785302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8a4af64fba4a998fd38cd9ee35c915, user_id=2e4117be18ad4e098d28005b07effc21, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:22.788311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:22.824270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 821/1663] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:22 2022] PUT /identity/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915/users/2e4117be18ad4e098d28005b07effc21/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:22.825838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:22.831805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:22.835048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:22.838728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:23.006432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5438d-30e6-4e33-b02c-9b86181b48a9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:23.026832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:23.027470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:23.027757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:23.028102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:23.028677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:23.030298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:23.042740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 843/1664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:23.063069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 822/1665] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:23.067351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:23.083523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995683-21f0-4e83-b415-7de7d3e0ed98 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:23.093012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:23.095425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:23.099385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:23.100078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:23.100755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:23.101038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] PATH_INFO: `/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915/users/2e4117be18ad4e098d28005b07effc21/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:23.107373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8a4af64fba4a998fd38cd9ee35c915, user_id=2e4117be18ad4e098d28005b07effc21, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:23.113289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743049c-5de8-426b-8a71-cba3636de372 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:23.146615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 844/1666] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:23 2022] PUT /identity/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915/users/2e4117be18ad4e098d28005b07effc21/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:23.158475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:23.159027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:23.159438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:23.228918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278812d4-0d45-4d12-a0f2-0057674177ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:23.229148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] MFA Rules not processed for user `2e4117be18ad4e098d28005b07effc21`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:23.230911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:23.329011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:23.342307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:23.342944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:23.343225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:23.343551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:23.487582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:23.490941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 845/1667] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:23.501946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:23.503130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:23.504732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:23.519418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 823/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:07:23.760057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f436-e168-4bf0-8928-d3340f820fe2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:23.770376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:23.773863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:23.774278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:23.774683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:23.819308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:23.820776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:23.832818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:23.864003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 846/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:24.665668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:24.691855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cbcf-7f43-4bff-acc4-bcf99e9718da service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:24.713902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:24.721609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:24.722089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:24.723636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:24.733214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:25.007724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:25.014327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf5940-1edd-4d5d-b0d7-23fdfd9be139 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:25.069735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 824/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:26.051368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:26.053261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:26.096085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f989f-bdd4-423a-b1fe-2cd43dbd077f service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:26.109205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:26.112029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:26.112491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:26.112914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] PATH_INFO: `/v3/projects/ee3b6870ab68482f8d3774918c83c850` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:26.117198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3b6870ab68482f8d3774918c83c850)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:26.125446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:26.353704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3b6870ab68482f8d3774918c83c850', 'request_id': 'req-f32b7727-1201-45ec-9fb1-582cf4def9d1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:26.367055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3b6870ab68482f8d3774918c83c850', 'request_id': 'req-f32b7727-1201-45ec-9fb1-582cf4def9d1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:26.381737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3b6870ab68482f8d3774918c83c850', 'request_id': 'req-f32b7727-1201-45ec-9fb1-582cf4def9d1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:26.433047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] The token cache is being invalidate because project ee3b6870ab68482f8d3774918c83c850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:26.433482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:26.437593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f32b7727-1201-45ec-9fb1-582cf4def9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:26.450487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 847/1671] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:26 2022] DELETE /identity/v3/projects/ee3b6870ab68482f8d3774918c83c850 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:26.452194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:26.452604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:26.452772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:26.499242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:26.501026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:26.729042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 825/1672] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:26.737866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:26.738467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:26.739128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:26.803764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:26.814095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:26.834616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 848/1673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:26.837205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:26.851662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9fa12-8d31-440a-9a15-919c8f8f41f0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:26.861520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:26.862553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:26.862976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:26.863405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:26.864313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:26.864754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:26.866563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:26.882487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 826/1674] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:26.887041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:26.916097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2ff72-a230-4b56-85e4-74eb6d14ffc6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:26.921743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:26.923159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:26.923578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:26.924139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:26.924925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:26.927812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:26.987136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 849/1675] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:26 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:26.989188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:27.004442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5ec1e-e431-4a39-9d1f-75df4cf4edf8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:27.058363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:27.190807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:27.191438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:27.191735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:27.191997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:27.192641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:27.207211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:27.245915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 827/1676] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:26 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:27.250053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:27.269291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60212d-266e-44a5-ab30-eeb25bea81cb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:27.285826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:27.287128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:27.287608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:27.288243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:27.298958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:27.301526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:27.328127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:27.340668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 850/1677] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:27.345306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061de68-bd40-420d-ae09-d88d845954ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:27.356089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:27.357111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:27.358639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:27.359088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:27.361125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:27.364808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c330-880a-4365-ae48-2c166aa40a01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:27.398439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 828/1678] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:27.402785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:27.423212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb2756-8b77-4b1a-8a2f-a4bf6242e393 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:27.430214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:27.431281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:27.431793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:27.432210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] PATH_INFO: `/v3/projects/be72394a76a94bb4a96be2138515eef0/users/97d605fe49164bbd83d5f66ee624a397/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:27.494776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be72394a76a94bb4a96be2138515eef0, user_id=97d605fe49164bbd83d5f66ee624a397, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:27.497792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:27.534071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 851/1679] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:27 2022] PUT /identity/v3/projects/be72394a76a94bb4a96be2138515eef0/users/97d605fe49164bbd83d5f66ee624a397/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:27.548732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed830-5050-4693-aba7-1b9e90abb18f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:27.549596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed830-5050-4693-aba7-1b9e90abb18f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:27.550549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed830-5050-4693-aba7-1b9e90abb18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:27.624825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b38ed830-5050-4693-aba7-1b9e90abb18f None None] MFA Rules not processed for user `97d605fe49164bbd83d5f66ee624a397`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:27.627378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b38ed830-5050-4693-aba7-1b9e90abb18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:27.836652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 829/1680] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:27.970603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:27.972438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:28.148714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902a79-d856-4794-96d0-44d17b77df14 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:28.157276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:28.157651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:28.158035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:28.158916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:28.169781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:28.171489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:28.215077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 852/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:29.872933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:29.873455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:29.873674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:29.992831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] MFA Rules not processed for user `9bf031090a79480291873a34ce703e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:30.000842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:30.228117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:30.230133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:30.301491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:30.369109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 830/1682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:30.384971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:30.392315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:30.486804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:30.536199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da12f-07be-4bd1-bf97-dc97b352ce37 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:30.562692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:30.573974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:30.574377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:30.574661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] PATH_INFO: `/v3/users/259b54d1c746470c987a9bcbcd6520ee` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:30.580318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259b54d1c746470c987a9bcbcd6520ee)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:30.582487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:30.703640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669e9d5-7c93-46f1-ba9e-cb8b00d0837f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:30.716219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259b54d1c746470c987a9bcbcd6520ee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:30.720257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:30.720884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:30.721171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:30.721446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:30.733953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259b54d1c746470c987a9bcbcd6520ee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:30.767096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259b54d1c746470c987a9bcbcd6520ee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:30.768129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259b54d1c746470c987a9bcbcd6520ee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:30.773477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1f9c1766-5850-40b5-9163-23d6d05ff1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259b54d1c746470c987a9bcbcd6520ee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:30.782313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:30.792081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:30.803909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 853/1683] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:30 2022] DELETE /identity/v3/users/259b54d1c746470c987a9bcbcd6520ee => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:30.809688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ba5-0936-46bc-bbd5-f26be957bc87 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:30.810301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ba5-0936-46bc-bbd5-f26be957bc87 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:30.810788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ba5-0936-46bc-bbd5-f26be957bc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:30.844951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 831/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:30.871294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f6bb5ba5-0936-46bc-bbd5-f26be957bc87 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:30.875868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6bb5ba5-0936-46bc-bbd5-f26be957bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:31.072979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 854/1685] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:31.090303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:31.092554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:31.269963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ac128-12cc-4d25-8d5f-c000b7ce4b93 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:31.390128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:31.391353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:31.391638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:31.391913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:31.436385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:31.441232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a128a8-35ec-434c-a6ef-99eeffad8029 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:31.493751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 832/1686] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:31.913152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:31.914344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:31.914768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:31.990506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] MFA Rules not processed for user `11ad6f5f60af4f9ebc73aab606c8a15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:31.995312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:32.091379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:32.204446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 855/1687] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:32.205233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:32.207521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:32.207863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:32.258089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] MFA Rules not processed for user `11ad6f5f60af4f9ebc73aab606c8a15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:32.259478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:32.291014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 833/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:32.303003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:32.306230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:32.442319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:32.444602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:32.466609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2389bd-7349-4bfd-a2d2-73fbc9eab592 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:32.480209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:32.484152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:32.485005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:32.485285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] PATH_INFO: `/v3/projects/1a08c237b1304b6d9113cfe736078e4c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:32.489446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a08c237b1304b6d9113cfe736078e4c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:32.493793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:32.539514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7483fa-ae17-44e7-9572-ec8689313477 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:32.554668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:32.555322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:32.555792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:32.556320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:32.613978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:32.617678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a08c237b1304b6d9113cfe736078e4c', 'request_id': 'req-5ef039f7-9db1-46f9-aff5-797df9605a9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:32.617840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:32.628619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:32.647290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a08c237b1304b6d9113cfe736078e4c', 'request_id': 'req-5ef039f7-9db1-46f9-aff5-797df9605a9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:32.648893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 856/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:32.661510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a08c237b1304b6d9113cfe736078e4c', 'request_id': 'req-5ef039f7-9db1-46f9-aff5-797df9605a9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:32.686487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] The token cache is being invalidate because project 1a08c237b1304b6d9113cfe736078e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:32.687186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:32.690117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ef039f7-9db1-46f9-aff5-797df9605a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:32.695317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 834/1690] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:32 2022] DELETE /identity/v3/projects/1a08c237b1304b6d9113cfe736078e4c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:32.699251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:32.719987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3205-ece2-4fd8-be34-f66ae76c6208 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:32.966623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:32.991659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:32.992849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:32.993174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] PATH_INFO: `/v3/users/ad2110182c9048cab9a8878d6cd9b9f7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:32.997821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2110182c9048cab9a8878d6cd9b9f7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:33.004919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:33.119508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2110182c9048cab9a8878d6cd9b9f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:33.138063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2110182c9048cab9a8878d6cd9b9f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:33.141374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:33.182939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2110182c9048cab9a8878d6cd9b9f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:33.184791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2110182c9048cab9a8878d6cd9b9f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:33.185710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45a7e5ea-733c-4f88-9fa0-47f2929ea785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2110182c9048cab9a8878d6cd9b9f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:33.215432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 857/1691] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:32 2022] DELETE /identity/v3/users/ad2110182c9048cab9a8878d6cd9b9f7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:33.489929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:33.490551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:33.490551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:33.492305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 835/1692] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 15:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:33.509538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb95-74df-41e5-bc94-d61dc82217b2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:33.509824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb95-74df-41e5-bc94-d61dc82217b2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:33.510098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb95-74df-41e5-bc94-d61dc82217b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:33.616831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-258ffb95-74df-41e5-bc94-d61dc82217b2 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:33.620571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-258ffb95-74df-41e5-bc94-d61dc82217b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:33.785639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 858/1693] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:33.820032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:33.824757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:33.870096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f97cf-f2db-4832-bd3c-237bc181e326 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:33.878747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:33.882110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:33.882429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:33.885752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:33.901929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:33.904735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:33.926127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 836/1694] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:33.945370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:33.945583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:33.945859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.009152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] MFA Rules not processed for user `0ebfb0c90f2e4b219012916ad2f9b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:34.010973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:34.174916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 859/1695] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:34.183834 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:34.186040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:34.354249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eac35-2060-4a1c-ad95-8ead8815f696 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:34.368741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:34.369379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:34.369655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:34.369929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.388851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:34.391226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eee3f-ca19-4687-94d0-794dfd46c2df service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:34.415746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 837/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:34.473777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:34.475417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:34.536498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81fa1-e601-40e0-bc5a-11605dc93624 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:34.537015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81fa1-e601-40e0-bc5a-11605dc93624 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:34.537015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81fa1-e601-40e0-bc5a-11605dc93624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.595003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-60a81fa1-e601-40e0-bc5a-11605dc93624 None None] MFA Rules not processed for user `4731961874e54d8a9f79f207572908aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:34.599236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-60a81fa1-e601-40e0-bc5a-11605dc93624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:34.665002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb08e0-dd01-4f64-b377-4d18c6e30c9d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:34.681228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:34.681883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:34.682160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:34.682463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] PATH_INFO: `/v3/users/c626e1e0b03d4e93a0afb6a092a3ceee` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.690326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c626e1e0b03d4e93a0afb6a092a3ceee)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:34.692489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:34.699016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:34.805580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 838/1697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:34.819224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46a21-b111-4ef9-a510-eb6a27aff42e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:34.820208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46a21-b111-4ef9-a510-eb6a27aff42e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:34.821130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46a21-b111-4ef9-a510-eb6a27aff42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.829495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c626e1e0b03d4e93a0afb6a092a3ceee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:34.847016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c626e1e0b03d4e93a0afb6a092a3ceee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:34.872240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cdc46a21-b111-4ef9-a510-eb6a27aff42e None None] MFA Rules not processed for user `4731961874e54d8a9f79f207572908aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:34.876591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cdc46a21-b111-4ef9-a510-eb6a27aff42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:34.886658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c626e1e0b03d4e93a0afb6a092a3ceee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:34.886658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c626e1e0b03d4e93a0afb6a092a3ceee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:34.886658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c626e1e0b03d4e93a0afb6a092a3ceee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:34.892872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 839/1698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:34.920687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 860/1699] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:34 2022] DELETE /identity/v3/users/c626e1e0b03d4e93a0afb6a092a3ceee => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:34.925063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:34.925349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:34.925623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:34.968117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:34.971270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.045550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:35.143388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:35.144286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 840/1700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:35.146606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.169100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:35.171427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.361581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a5307-c462-4c56-8f47-1c81ce1dc5d2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:35.369010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:35.369635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:35.369911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:35.370176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:35.407690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:35.409957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:35.418584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375df4-35eb-4ac7-8c41-82e90319acb7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:35.433544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:35.434410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:35.434410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:35.434701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:35.436892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.438955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 841/1701] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:35.519296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:35.520533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08437d-e674-4e8b-bada-2b79e54b078b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:35.535341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 861/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:07:35.665331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:35.666839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.707174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccdbde-50be-4b39-844a-5c5033088fab service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:35.712483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:35.714049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:35.715013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:35.715770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] PATH_INFO: `/v3/projects/c35592de335c4fa8b0416f8990e13d92` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:35.722045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35592de335c4fa8b0416f8990e13d92)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:35.726805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:35.818573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35592de335c4fa8b0416f8990e13d92', 'request_id': 'req-b427e2ae-fe45-4815-ab5f-536e9dc599af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:35.832202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35592de335c4fa8b0416f8990e13d92', 'request_id': 'req-b427e2ae-fe45-4815-ab5f-536e9dc599af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:35.840238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35592de335c4fa8b0416f8990e13d92', 'request_id': 'req-b427e2ae-fe45-4815-ab5f-536e9dc599af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:35.864938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] The token cache is being invalidate because project c35592de335c4fa8b0416f8990e13d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:35.865918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:35.867037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b427e2ae-fe45-4815-ab5f-536e9dc599af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:35.874816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 842/1703] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:35 2022] DELETE /identity/v3/projects/c35592de335c4fa8b0416f8990e13d92 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:35.875224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:35.875514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:35.875812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:35.921367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:35.922838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:35.943381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:36.090495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 862/1704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:36.106504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.106857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.107021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.108266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.109376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.163271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:36.167195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.179875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 843/1705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:36.185057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.196134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4af06-4aec-4bbe-8c7f-10eb7f1f65ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.202641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:36.203313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.203616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.203886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.204749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:36.205063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:36.206827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:36.225520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 844/1706] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:36.231301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.253970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160f10-e590-4867-b82a-1aaefdce23f9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.260816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f1d4-d345-4faa-a7ce-98fc8b23568e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.269293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:36.269925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.270039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:36.270202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.270533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.271039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.271391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.271718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:36.271843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.273644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca60ef-5268-4cef-bab6-f52962468a11 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:36.274181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.293129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:36.297644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:36.312310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 863/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:07:36.334006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.335789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 845/1708] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:36 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:36.348178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16944-52dd-4d32-bc51-e7a1c04b9d74 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.374850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0316-8b9a-4c82-bb81-9d74e3a4244b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.375423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0316-8b9a-4c82-bb81-9d74e3a4244b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.375709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0316-8b9a-4c82-bb81-9d74e3a4244b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.378004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 846/1709] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 15:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:36.383566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363fe74-59dd-47e9-8faa-333064e9e878 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.384273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363fe74-59dd-47e9-8faa-333064e9e878 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.384816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363fe74-59dd-47e9-8faa-333064e9e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.451157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0363fe74-59dd-47e9-8faa-333064e9e878 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:36.455895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0363fe74-59dd-47e9-8faa-333064e9e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.496689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:36.556568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:36.558565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.559192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.559602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.560394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:36.563391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:36.637891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 847/1710] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:36.639246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.639536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.639813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.639986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 864/1711] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:36 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:36.641743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.669766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.703949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] MFA Rules not processed for user `11ad6f5f60af4f9ebc73aab606c8a15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:36.705430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d91f8a-9a7d-432b-a0c4-81835171206f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.707493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:36.723483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:36.729083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:36.729761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:36.730118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] PATH_INFO: `/v3/projects/9783519e8bd84ed09836434f1e9d42a4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:36.742591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9783519e8bd84ed09836434f1e9d42a4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:36.749247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:36.885464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:36.903425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 848/1712] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:36.904621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:36.920285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9783519e8bd84ed09836434f1e9d42a4', 'request_id': 'req-b2c015f3-560e-49d8-8da1-b3322e26bb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:36.941114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9783519e8bd84ed09836434f1e9d42a4', 'request_id': 'req-b2c015f3-560e-49d8-8da1-b3322e26bb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:36.952644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a631-503d-489e-9db8-009dd894b00e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:36.962732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9783519e8bd84ed09836434f1e9d42a4', 'request_id': 'req-b2c015f3-560e-49d8-8da1-b3322e26bb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.023847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] The token cache is being invalidate because project 9783519e8bd84ed09836434f1e9d42a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:37.024161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.030770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.045528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 865/1713] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:36 2022] DELETE /identity/v3/projects/9783519e8bd84ed09836434f1e9d42a4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:37.050379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:37.060118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:37.215616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:37.216825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.217244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.217663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.218555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:37.220839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:37.237492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c015f3-560e-49d8-8da1-b3322e26bb9d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:37.247788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:37.248598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.249320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.250340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.262222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:37.277277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 849/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:37.283659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:37.297749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:37.297932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:37.303128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:37.326146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34898c0-42c0-46da-842b-13ab11d8176c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:37.338617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:37.339411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.339800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.340192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] PATH_INFO: `/v3/users/2e4117be18ad4e098d28005b07effc21` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.347356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 866/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:37.348003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4117be18ad4e098d28005b07effc21)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:37.348140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:37.349494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 15:07:37.349494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 11 15:07:37.349494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: Sep 11 15:07:37.351042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:37.351645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:37.411726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604bdcc-9a75-4604-be27-3fb3496f4db9 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:37.427795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:37.428741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.432477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.433386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.434176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:37.435856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:37.483620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 867/1716] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:37.492263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:37.508605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4117be18ad4e098d28005b07effc21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.510501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4117be18ad4e098d28005b07effc21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.521324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df088c6-bf5f-4059-8010-ae32129b7bc5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:37.534221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:37.536118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.536398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.537984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] PATH_INFO: `/v3/projects/290e1ccd762e4e16adbf3e6b45152e60/users/5d08beb2bd734f20a77428dc31567235/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.551898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4117be18ad4e098d28005b07effc21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.583650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290e1ccd762e4e16adbf3e6b45152e60, user_id=5d08beb2bd734f20a77428dc31567235, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:37.590418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b83c07-0e13-43bf-b486-fc8f905b9633 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:37.592486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:37.614287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4117be18ad4e098d28005b07effc21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.615483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4117be18ad4e098d28005b07effc21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:37.634221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 868/1717] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:37 2022] PUT /identity/v3/projects/290e1ccd762e4e16adbf3e6b45152e60/users/5d08beb2bd734f20a77428dc31567235/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:37.636321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:37.636593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:37.636977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:37.651248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 850/1718] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:37 2022] DELETE /identity/v3/users/2e4117be18ad4e098d28005b07effc21 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:37.715551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] MFA Rules not processed for user `5d08beb2bd734f20a77428dc31567235`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:37.718900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:37.928990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 869/1719] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:37.933773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:37.936133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:38.151841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dcba-c0ed-4b43-9fa2-2da6b80b5783 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.167818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.169229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.169587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.169926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.170761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.175782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a5aef-c42e-44bd-9488-121fce104f90 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:38.236518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 851/1720] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:37 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:38.237332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:38.253669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bc56-7bd1-4f14-9047-0918d4a1e283 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.279455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:38.422967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.423930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.424390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.424837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.425766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.428533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:38.469036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.470012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.470482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.494834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 870/1721] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:38 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:38.500192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:38.517077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] MFA Rules not processed for user `0ebfb0c90f2e4b219012916ad2f9b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:38.523469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:38.529188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8928bd-e86d-4d3f-b6f4-6afea387d488 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.542102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.547406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.547945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.548490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.550470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.554000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:38.583618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 871/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:38.588806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:38.606999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c715cd-a5ab-454a-9030-7f739886f0e3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.625845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.626926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.627375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.627836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] PATH_INFO: `/v3/projects/8b5c86000a5947f8ba025684c89a4114/users/053b373213674cb7bd6618efc7bedb15/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.672788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c86000a5947f8ba025684c89a4114, user_id=053b373213674cb7bd6618efc7bedb15, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.677432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 852/1723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:38.677675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:38.731264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 872/1724] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:38 2022] PUT /identity/v3/projects/8b5c86000a5947f8ba025684c89a4114/users/053b373213674cb7bd6618efc7bedb15/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:38.735922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:38.753799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364f4ad-7ca3-4bd0-a1f3-4b45fb4a8dc6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.905431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.906457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.907034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.907535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.908661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.910723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01414ec-e054-43b3-bd4b-b4a2a90f1a04 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:38.931741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 853/1725] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:38.933163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:38.949451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028d2f-857a-42c5-b1af-5684174fd7df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:38.957755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:38.958599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:38.959252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:38.959719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] PATH_INFO: `/v3/projects/8b5c86000a5947f8ba025684c89a4114/users/053b373213674cb7bd6618efc7bedb15/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:38.963114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c86000a5947f8ba025684c89a4114, user_id=053b373213674cb7bd6618efc7bedb15, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:38.966848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:39.011394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 873/1726] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:38 2022] PUT /identity/v3/projects/8b5c86000a5947f8ba025684c89a4114/users/053b373213674cb7bd6618efc7bedb15/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:39.012614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:39.013064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:39.013212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:39.055024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:39.084198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] MFA Rules not processed for user `053b373213674cb7bd6618efc7bedb15`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:39.085474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:39.236571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 854/1727] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:39.249620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:39.251795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:39.399273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dfa9-441f-4527-8374-3f6449da8e83 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:39.410166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:39.410166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:39.410166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:39.410166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:39.423243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:39.424692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6286-1d16-4436-bb18-b0d307bd46fa service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:39.470449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 874/1728] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:39.503700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:39.506787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:39.698117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6589-5e0e-4b73-a658-03d058e4fb2a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:39.705449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:39.706187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:39.706727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:39.707097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] PATH_INFO: `/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:39.708359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8a4af64fba4a998fd38cd9ee35c915)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:39.710425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:39.832691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8a4af64fba4a998fd38cd9ee35c915', 'request_id': 'req-557def61-9118-4ea1-92c9-0e70ea62719c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:39.850209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8a4af64fba4a998fd38cd9ee35c915', 'request_id': 'req-557def61-9118-4ea1-92c9-0e70ea62719c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:39.860833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8a4af64fba4a998fd38cd9ee35c915', 'request_id': 'req-557def61-9118-4ea1-92c9-0e70ea62719c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:39.891391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002149-824c-4bd2-b4ce-307376046c7e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:39.891692 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002149-824c-4bd2-b4ce-307376046c7e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:39.891809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] The token cache is being invalidate because project 2f8a4af64fba4a998fd38cd9ee35c915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:39.891967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002149-824c-4bd2-b4ce-307376046c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:39.892055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:39.896322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-557def61-9118-4ea1-92c9-0e70ea62719c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:39.901369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 855/1729] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:39 2022] DELETE /identity/v3/projects/2f8a4af64fba4a998fd38cd9ee35c915 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:39.903330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0322d-e41a-44db-bc85-39a447aee75a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:39.903661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0322d-e41a-44db-bc85-39a447aee75a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:39.903897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0322d-e41a-44db-bc85-39a447aee75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:39.940217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ad002149-824c-4bd2-b4ce-307376046c7e None None] MFA Rules not processed for user `9bf031090a79480291873a34ce703e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:39.941460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad002149-824c-4bd2-b4ce-307376046c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:39.993385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-87f0322d-e41a-44db-bc85-39a447aee75a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:39.998601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-87f0322d-e41a-44db-bc85-39a447aee75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:40.083160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:40.211205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 875/1730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:40.213262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.213710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.214137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.231099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:40.338905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 856/1731] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:40.341403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:40.344341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:40.356325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.357176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.357626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.441355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:40.442691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:40.474632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 857/1732] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:40.476300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:40.478225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:40.527489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 876/1733] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:40.529637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:40.561946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051c54c-a82d-4b82-8061-0d21e5ea59c1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:40.572418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:40.573444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.573871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.574198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.575418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:40.575418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:40.577985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:40.599160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 877/1734] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:40.602432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:40.651228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e9d1-370a-4572-adbb-52c77dd99493 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:40.667124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:40.668119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.669589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.672186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.673875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:40.677555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:40.702309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787416-a5fc-4b51-a832-5c207670f32b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:40.710830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053b373213674cb7bd6618efc7bedb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5c86000a5947f8ba025684c89a4114', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:40.711948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.714885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.715135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.715927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:40.717222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:40.720231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:40.755806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 858/1735] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:40.762649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 878/1736] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:40 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:40.763839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:40.771718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:40.813861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810c22-0c88-4f18-a5f6-54fb913de2e6 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:40.934444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053b373213674cb7bd6618efc7bedb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5c86000a5947f8ba025684c89a4114', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:40.935913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:40.936495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:40.937169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:40.938308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:40.943361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:40.995566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ec07-26a1-44d7-b730-0a7947cd7117 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.004271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.004953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.009665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.009847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.017876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.022065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.026309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 859/1737] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:40 2022] POST /identity/v3/projects => generated 354 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:41.028342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.034529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:41.084434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 879/1738] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:40 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:41.086932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.119771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba779f-58fa-4585-bb41-fb3f64a6d3e7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.157647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:41.199606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:41.284003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053b373213674cb7bd6618efc7bedb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5c86000a5947f8ba025684c89a4114', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.284910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.285313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.285592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.286460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:41.286829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.289034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.312785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbc67-83be-4cb5-bbeb-bdb6e6f65881 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.321311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 880/1739] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:41.324923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.335123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.335123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.340438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.340438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.451816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39fcd2-6e5b-4f20-b96f-64b650107270 tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.459317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.460029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.460315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.460583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.461304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.463121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.478372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 881/1740] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:41.481215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.496963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f33ba-2aa6-41be-ac66-ae7c6ce6becf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.502238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.504451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053b373213674cb7bd6618efc7bedb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5c86000a5947f8ba025684c89a4114', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.505762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.506433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.506756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.507028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] PATH_INFO: `/v3/projects/19cb85f47a2b4a91937dfacfc2f4fbff` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.508186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19cb85f47a2b4a91937dfacfc2f4fbff)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.511053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.521368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 860/1741] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:07:41.539235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.551456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c78a-5e84-44fe-8966-1f9d81bd6679 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.586934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19cb85f47a2b4a91937dfacfc2f4fbff', 'request_id': 'req-704b84db-694e-4bae-abea-7a25a30129be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:41.605051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19cb85f47a2b4a91937dfacfc2f4fbff', 'request_id': 'req-704b84db-694e-4bae-abea-7a25a30129be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:41.638952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19cb85f47a2b4a91937dfacfc2f4fbff', 'request_id': 'req-704b84db-694e-4bae-abea-7a25a30129be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:41.691963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] The token cache is being invalidate because project 19cb85f47a2b4a91937dfacfc2f4fbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:41.692225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:41.693279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:41.701091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 882/1742] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:41 2022] DELETE /identity/v3/projects/19cb85f47a2b4a91937dfacfc2f4fbff => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:41.720165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.738967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.739255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.739530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.740210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.741914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5117cc1-2f82-425b-9ec9-ad48c48f5091 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.792148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:41.793625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:41.805159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 861/1743] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:41.830137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b84db-694e-4bae-abea-7a25a30129be tempest-VolumeQuotaClassesTest-1726021171 tempest-VolumeQuotaClassesTest-1726021171-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:41.852193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:41.852900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.853239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.855820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] PATH_INFO: `/v3/projects/d35ec44c9c804e1990995ff3354ea365/users/55fb75f7a643481cb40004ee389d978b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.921033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35ec44c9c804e1990995ff3354ea365, user_id=55fb75f7a643481cb40004ee389d978b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:41.928555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:41.981859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:41.982035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:41.982187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:41.991892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 883/1744] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:41 2022] PUT /identity/v3/projects/d35ec44c9c804e1990995ff3354ea365/users/55fb75f7a643481cb40004ee389d978b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:42.091805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] MFA Rules not processed for user `55fb75f7a643481cb40004ee389d978b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:42.093046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:42.303750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:42.305986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:42.381509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:42.393140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:42.503276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eefa7-9933-40a2-8b03-d11c7c1e7edc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:42.512613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:42.513803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:42.514373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:42.514788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] PATH_INFO: `/v3/users/5d08beb2bd734f20a77428dc31567235` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:42.517299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d08beb2bd734f20a77428dc31567235)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:42.522733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 862/1745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:42.530057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:42.534605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:42.614029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059760b2-5a1c-40b9-8331-dd8713259b58 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:42.643371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:42.645762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:42.647301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:42.647603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:42.651180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:42.653414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:42.688890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d08beb2bd734f20a77428dc31567235'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:42.701615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d08beb2bd734f20a77428dc31567235'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:42.732563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d08beb2bd734f20a77428dc31567235'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:42.734001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d08beb2bd734f20a77428dc31567235'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:42.735320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1784e69a-cf31-46a8-905e-52cd61f6c3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d08beb2bd734f20a77428dc31567235'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:42.770556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 884/1746] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:42 2022] DELETE /identity/v3/users/5d08beb2bd734f20a77428dc31567235 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:42.774629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad73-8e72-49c2-8974-ee81512d7fdc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:42.775393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad73-8e72-49c2-8974-ee81512d7fdc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:42.775847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad73-8e72-49c2-8974-ee81512d7fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:42.809583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 863/1747] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:42 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:42.813951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:42.819092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:42.819359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b981ad73-8e72-49c2-8974-ee81512d7fdc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:42.820554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b981ad73-8e72-49c2-8974-ee81512d7fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:43.119617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 885/1748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:43.130515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.139861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.144404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.244324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:43.244722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a30e-bd4a-4a1d-a3c7-de57bbdb4f23 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:43.252542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:43.275048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:43.275675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.275995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.276357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.276945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:43.278954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:43.428165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 864/1749] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:42 2022] POST /identity/v3/users => generated 299 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:43.428165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:43.449593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:43.451557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:43.519907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 886/1750] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:43.525428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:43.592512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72d9e-926f-423a-9d75-aa49347b27e7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:43.609693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:43.613086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.614911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.616009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.621143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:43.624370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:43.671462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 887/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:43.693207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:43.703591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:43.750509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a4b4-7848-460c-8605-663d1190c7cf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:43.755767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fc8f3-a394-4832-a0fa-b60a2177834c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:43.761164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:43.776490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:43.778043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.780256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.780609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.786060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.790183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.790581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.825611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:43.827125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:43.827255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:43.832169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:43.845192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 888/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:43.846470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:43.880608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d50f6-3b9f-4253-8bdb-d3d76b02e171 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:43.890622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:43.891641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:43.892037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:43.892394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] PATH_INFO: `/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2/users/4f22f84682914cf981b23a5bfa64313e/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:43.897937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 865/1753] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:43.915220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc5cbd4f14d455f934dabb9e21c4cc2, user_id=4f22f84682914cf981b23a5bfa64313e, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:43.918992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:43.939593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 889/1754] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:43 2022] PUT /identity/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2/users/4f22f84682914cf981b23a5bfa64313e/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:43.945063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:43.966904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a265184-3218-4e04-a322-bb73a4df9262 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:44.207502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:44.242398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:44.243851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:44.244210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:44.244542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:44.249035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:44.258237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae2b22-ce7c-479f-b9ea-935b491cb742 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:44.324021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:44.326399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 866/1755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:44.340605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0858a-59b6-4db9-abf6-0a485533381d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:44.365138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:44.368190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:44.371265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:44.371582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] PATH_INFO: `/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2/users/4f22f84682914cf981b23a5bfa64313e/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:44.379697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc5cbd4f14d455f934dabb9e21c4cc2, user_id=4f22f84682914cf981b23a5bfa64313e, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:44.393635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:44.436366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 890/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:44 2022] PUT /identity/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2/users/4f22f84682914cf981b23a5bfa64313e/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:07:44.448058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:44.448570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:44.448877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:44.571269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] MFA Rules not processed for user `4f22f84682914cf981b23a5bfa64313e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:44.572797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:44.888145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 867/1757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:44.902333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:44.904325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:45.148393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cbb43-7580-4982-9ede-395e8d276ca6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:45.164325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:45.168937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:45.169495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:45.170615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:45.237906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:45.239527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a847f8-cd4c-44ae-a186-50a6824bf713 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:45.301980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 891/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:45.394118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:45.687356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad155f4d-31c2-457f-89ac-d308ad682524 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:45.708611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:45.709788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:45.712108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:45.712750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] PATH_INFO: `/v3/users/55fb75f7a643481cb40004ee389d978b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:45.720622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fb75f7a643481cb40004ee389d978b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:45.740052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:45.858230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fb75f7a643481cb40004ee389d978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:45.861111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fb75f7a643481cb40004ee389d978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:45.894378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fb75f7a643481cb40004ee389d978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:45.991072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fb75f7a643481cb40004ee389d978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:45.996589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fb75f7a643481cb40004ee389d978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:46.014745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:46.042967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 868/1759] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:45 2022] DELETE /identity/v3/users/55fb75f7a643481cb40004ee389d978b => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:46.045508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:46.046608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:46.047353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:46.130325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:46.132262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:46.326601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 892/1760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:46.367811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:46.369491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:46.526642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bda2a-7474-4d36-9828-3f297ba34b66 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:46.533075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:46.536117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:46.536877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:46.537897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:46.568290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:46.572976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a993-698c-42ca-b5e0-637d1c0e6187 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:46.598741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 869/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:48.787202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:48.790942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:48.810317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620e7ca-9f2a-467d-8c65-d96609634c8e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:48.843315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:48.844035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:48.844401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:48.844719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] PATH_INFO: `/v3/users/97d605fe49164bbd83d5f66ee624a397` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:48.849148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d605fe49164bbd83d5f66ee624a397)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:48.851438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:48.926940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:48.965392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d605fe49164bbd83d5f66ee624a397'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:48.987332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d605fe49164bbd83d5f66ee624a397'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.031600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d605fe49164bbd83d5f66ee624a397'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.036292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d605fe49164bbd83d5f66ee624a397'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.045233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d605fe49164bbd83d5f66ee624a397'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.094586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 893/1762] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:48 2022] DELETE /identity/v3/users/97d605fe49164bbd83d5f66ee624a397 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:49.099010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:49.099525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:49.099525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:49.156281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:49.157526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:49.396211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:49.397722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:49.481868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 870/1763] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:49.618120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:49.621399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:49.641107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039a7e9-76df-4e3d-97fa-f45b4736d0bb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:49.647125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:49.647955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:49.648341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:49.648663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] PATH_INFO: `/v3/projects/290e1ccd762e4e16adbf3e6b45152e60` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:49.650382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290e1ccd762e4e16adbf3e6b45152e60)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:49.652439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:49.791231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290e1ccd762e4e16adbf3e6b45152e60', 'request_id': 'req-74dbf0f0-138b-41ef-9416-70ec9d192428'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.795558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166959b-017f-47f9-891a-9a034310ad81 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:49.818212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290e1ccd762e4e16adbf3e6b45152e60', 'request_id': 'req-74dbf0f0-138b-41ef-9416-70ec9d192428'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.842794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290e1ccd762e4e16adbf3e6b45152e60', 'request_id': 'req-74dbf0f0-138b-41ef-9416-70ec9d192428'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.892856 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] The token cache is being invalidate because project 290e1ccd762e4e16adbf3e6b45152e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:49.893209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.896667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:49.904303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 894/1764] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:49 2022] DELETE /identity/v3/projects/290e1ccd762e4e16adbf3e6b45152e60 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:07:49.905422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:49.910417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:49.957324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:49.957958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:49.958242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:49.961185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:49.965578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:50.002774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:50.019817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:50.108202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbf0f0-138b-41ef-9416-70ec9d192428 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:50.139221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:50.140197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:50.140673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:50.141119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] PATH_INFO: `/v3/users/053b373213674cb7bd6618efc7bedb15` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:50.142649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=053b373213674cb7bd6618efc7bedb15)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:50.153481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:50.173415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:50.175604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:50.213087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 871/1765] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:50.223858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:50.238809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:50.289146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9169d4-41a9-4ac8-a58f-4fb4488930dc service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:50.298599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053b373213674cb7bd6618efc7bedb15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.306446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:50.307569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:50.308061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:50.308596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] PATH_INFO: `/v3/projects/d35ec44c9c804e1990995ff3354ea365` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:50.310172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35ec44c9c804e1990995ff3354ea365)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:50.312783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:50.319069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053b373213674cb7bd6618efc7bedb15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.351710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053b373213674cb7bd6618efc7bedb15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.353805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053b373213674cb7bd6618efc7bedb15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.354624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053b373213674cb7bd6618efc7bedb15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.389412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 895/1766] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:49 2022] DELETE /identity/v3/users/053b373213674cb7bd6618efc7bedb15 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:50.445204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35ec44c9c804e1990995ff3354ea365', 'request_id': 'req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.465430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35ec44c9c804e1990995ff3354ea365', 'request_id': 'req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.485759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35ec44c9c804e1990995ff3354ea365', 'request_id': 'req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.527389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] The token cache is being invalidate because project d35ec44c9c804e1990995ff3354ea365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:50.537912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.540825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b1dbf5d-5330-42b7-ba55-6b6d6985ac35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.542844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 872/1767] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:50 2022] DELETE /identity/v3/projects/d35ec44c9c804e1990995ff3354ea365 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:50.548048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:50.549801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:50.558007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962506-b402-4383-a799-cf8e89cc1055 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:50.558311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962506-b402-4383-a799-cf8e89cc1055 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:50.558661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962506-b402-4383-a799-cf8e89cc1055 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:50.563328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 873/1768] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:07:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:50.664053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a55e-a32d-4129-ba19-1d7b00d93dfa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:50.791121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:50.791615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:50.792383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:50.827900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:50.829540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:50.831347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:50.831853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] PATH_INFO: `/v3/users/4f22f84682914cf981b23a5bfa64313e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:50.836391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f22f84682914cf981b23a5bfa64313e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:50.839750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:50.840562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:50.841008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:50.848370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:50.966917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f22f84682914cf981b23a5bfa64313e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:50.996320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f22f84682914cf981b23a5bfa64313e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:51.037215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f22f84682914cf981b23a5bfa64313e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:51.040010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f22f84682914cf981b23a5bfa64313e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:51.045586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f22f84682914cf981b23a5bfa64313e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:51.081385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 896/1769] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:50 2022] DELETE /identity/v3/users/4f22f84682914cf981b23a5bfa64313e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:51.087493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 874/1770] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:51.995358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:51.997174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:52.173880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779072c-c6a8-4dc0-85d3-0a7871e7db9e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:52.193649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:52.194541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:52.194926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:52.195306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:52.215348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:52.217285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:52.250225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 897/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:54.078992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:54.080528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:54.113526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597253-d175-4cdd-8df5-68a74b54c380 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:54.185399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:54.338572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:54.339523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:54.340889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:54.343423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] PATH_INFO: `/v3/projects/8b5c86000a5947f8ba025684c89a4114` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:54.347705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5c86000a5947f8ba025684c89a4114)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:54.351176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:54.599626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5c86000a5947f8ba025684c89a4114', 'request_id': 'req-afe89b52-f04a-469f-913e-c7f8d2347c76'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.626856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5c86000a5947f8ba025684c89a4114', 'request_id': 'req-afe89b52-f04a-469f-913e-c7f8d2347c76'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.653584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5c86000a5947f8ba025684c89a4114', 'request_id': 'req-afe89b52-f04a-469f-913e-c7f8d2347c76'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.670702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:54.672911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:54.696463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bc74-1811-4bcd-b21f-d0e973e7194a service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:54.712379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] The token cache is being invalidate because project 8b5c86000a5947f8ba025684c89a4114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:54.712829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.715253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afe89b52-f04a-469f-913e-c7f8d2347c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.725271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 875/1772] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:54 2022] DELETE /identity/v3/projects/8b5c86000a5947f8ba025684c89a4114 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:54.730575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce789e-9d7a-4de7-b04c-7ad083834d4b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:54.730971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce789e-9d7a-4de7-b04c-7ad083834d4b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:54.732945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce789e-9d7a-4de7-b04c-7ad083834d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:54.808626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f6ce789e-9d7a-4de7-b04c-7ad083834d4b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:54.818191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f6ce789e-9d7a-4de7-b04c-7ad083834d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:54.831921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:54.832874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:54.833271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:54.833628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] PATH_INFO: `/v3/projects/be72394a76a94bb4a96be2138515eef0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:54.835254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be72394a76a94bb4a96be2138515eef0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:54.839278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:54.844072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 876/1773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:54.852002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:54.852287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:54.852589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:54.859648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:54.907192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:54.908463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:54.938232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be72394a76a94bb4a96be2138515eef0', 'request_id': 'req-09ba8d41-4d62-4f3f-8fc4-602b246285f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.941637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 877/1774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:54.942781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:54.957867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be72394a76a94bb4a96be2138515eef0', 'request_id': 'req-09ba8d41-4d62-4f3f-8fc4-602b246285f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:54.965188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3be530-7da7-4656-abe6-d3bb31a48073 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:54.998804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be72394a76a94bb4a96be2138515eef0', 'request_id': 'req-09ba8d41-4d62-4f3f-8fc4-602b246285f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:55.028669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] The token cache is being invalidate because project be72394a76a94bb4a96be2138515eef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:55.029305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:55.030261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09ba8d41-4d62-4f3f-8fc4-602b246285f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:55.040946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 898/1775] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:54 2022] DELETE /identity/v3/projects/be72394a76a94bb4a96be2138515eef0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:55.042474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf37bce-66d3-45c4-8320-d87f70330823 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.042737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf37bce-66d3-45c4-8320-d87f70330823 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.043055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf37bce-66d3-45c4-8320-d87f70330823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.097947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bdf37bce-66d3-45c4-8320-d87f70330823 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:55.100141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bdf37bce-66d3-45c4-8320-d87f70330823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:55.118479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.120670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.121059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.124374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.125179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:55.125407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.130717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.175031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 878/1776] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:55.177436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.182439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:55.213864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67e2e7-2f2b-4886-94e4-99db3f4b020d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.230452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.232282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.233556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.234142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.236935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.242388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.339303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 879/1777] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:55.341597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.344227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 899/1778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:55.360061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e034-e824-4b58-91f7-cbda5cfa8c47 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.360583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e034-e824-4b58-91f7-cbda5cfa8c47 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.361110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e034-e824-4b58-91f7-cbda5cfa8c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.396072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:55.404331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0d39e034-e824-4b58-91f7-cbda5cfa8c47 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:55.407660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0d39e034-e824-4b58-91f7-cbda5cfa8c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:55.602374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0305-3e7f-4263-aa84-4806bf63ea39 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.609137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.611166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.611166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.611166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.611725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.615193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.653546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 880/1779] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:55.657877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.722907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1382-a7bf-4b9e-99ea-2aea5c944642 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.733351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.735496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.736582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.737521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.738556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.741437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.747718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 900/1780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:55.749375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905adc8-03f8-410a-905a-69abb121be37 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.749764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905adc8-03f8-410a-905a-69abb121be37 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.750142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905adc8-03f8-410a-905a-69abb121be37 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.751925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 901/1781] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:07:55.752797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905adc8-03f8-410a-905a-69abb121be37 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.763671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 881/1782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:55.768044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.787191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905adc8-03f8-410a-905a-69abb121be37 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.799051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ee25-efa9-450a-afbc-5bd022f7c234 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.805258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.805479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.806100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.806217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.806407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.806675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.806769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.807267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.807386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:55.807626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.808247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.809705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685da88-7377-442d-b469-857e01a7806f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.810063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.823612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 902/1783] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:55.824462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 882/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:07:55.825069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.825357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.825629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.831794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.849987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e567d7-a36a-4854-ba54-7f05c6f3702e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:55.852310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:55.854025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:55.855447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:55.856184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:55.856582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:55.856997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:55.857854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:55.860902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:55.882658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:55.918499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 883/1785] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:55.919715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.954714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 903/1786] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:55.956517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:55.969590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71622c22-44f6-44b5-9952-265c52167b33 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.040940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89e13b-10ce-4d00-b00f-c2f104535add admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.046662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.047631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.047910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.048176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] PATH_INFO: `/v3/projects/e595e4d255ad47a29056f78289c00c74/users/608794369f41467ca150ddc9c5f7f78d/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.072627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e595e4d255ad47a29056f78289c00c74, user_id=608794369f41467ca150ddc9c5f7f78d, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.076280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.086166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.087016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.087473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.087899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.088867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.093880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466d37-96f1-47e6-98af-5054fc6377e0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.103222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 884/1787] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:55 2022] PUT /identity/v3/projects/e595e4d255ad47a29056f78289c00c74/users/608794369f41467ca150ddc9c5f7f78d/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:56.109317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.111322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.157370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 904/1788] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:55 2022] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:56.162791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.163256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.163559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.174611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:56.205755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca074fa-c6b3-4ee9-9b2e-27b02c67db29 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.211563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.212471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.212824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.213174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] PATH_INFO: `/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.215030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc5cbd4f14d455f934dabb9e21c4cc2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.217802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.246752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] MFA Rules not processed for user `608794369f41467ca150ddc9c5f7f78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:56.266176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.281261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc5cbd4f14d455f934dabb9e21c4cc2', 'request_id': 'req-993756f3-0bde-4ad7-a816-00ee418d6114'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:56.302321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc5cbd4f14d455f934dabb9e21c4cc2', 'request_id': 'req-993756f3-0bde-4ad7-a816-00ee418d6114'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:56.302321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc5cbd4f14d455f934dabb9e21c4cc2', 'request_id': 'req-993756f3-0bde-4ad7-a816-00ee418d6114'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:56.317475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] The token cache is being invalidate because project 0cc5cbd4f14d455f934dabb9e21c4cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:56.318952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:56.320024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:56.325484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 885/1789] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:56 2022] DELETE /identity/v3/projects/0cc5cbd4f14d455f934dabb9e21c4cc2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:56.327220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.329833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.432814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993756f3-0bde-4ad7-a816-00ee418d6114 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.438805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.439585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.440041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.440315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.441265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.444162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a89d23-5b74-4adb-bab8-c9f160decb8f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.451694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 905/1790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:56.456622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.462001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.465154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 886/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:56.466603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.466889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.467161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.494783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:56.496329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.510467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 887/1792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:56.512394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.519761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.538789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32731-eada-4a46-a1c6-f5bfc43bc6b3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.544677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:56.546178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.547118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.547588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.547866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.548510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.552904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.601475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 888/1793] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:56.601475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.611088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef1e0-9a27-4d19-8dab-fb008b5b2e25 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.653032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:56.688729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f885d-d261-4177-a845-873da1e2f4fb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.694781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.695749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.696121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.696452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.697160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.700302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2865-323c-425a-9045-3d363b017f34 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.715173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 889/1794] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:56.716491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d507-dc87-462c-a375-af8acb873290 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.720722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d507-dc87-462c-a375-af8acb873290 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.721009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d507-dc87-462c-a375-af8acb873290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.744369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.745018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.745398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.745723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.747772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.760989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.762770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.779151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-de48d507-dc87-462c-a375-af8acb873290 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:56.788103 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 906/1795] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:56.788385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.789798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-de48d507-dc87-462c-a375-af8acb873290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:56.819501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34918f0d-d9d4-43fe-84bd-699f060c90ba service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.835667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.836370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.836616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.836939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.837741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.844360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.845924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 890/1796] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:56.847780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d507-dc87-462c-a375-af8acb873290 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.873586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d507-dc87-462c-a375-af8acb873290 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.888238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 907/1797] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:56.888977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.889690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.889992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.890254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.890558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] PATH_INFO: `/v3/projects/3438943fbca541a18545ad9672e3fc8e/users/315cdc9dba1e4d94b49d119cd39b6eaa/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.916190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3438943fbca541a18545ad9672e3fc8e, user_id=315cdc9dba1e4d94b49d119cd39b6eaa, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.920036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.925021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a557a4-b929-4a3f-93f5-837a753de39e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:56.945503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:56.946421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.946792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.947247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:56.948023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:07:56.948461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:56.950931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320d99d-5746-4e7e-b064-edb31190df66 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:56.969624 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 891/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:56 2022] PUT /identity/v3/projects/3438943fbca541a18545ad9672e3fc8e/users/315cdc9dba1e4d94b49d119cd39b6eaa/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:56.970608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:56.988695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 908/1799] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:07:56.988695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:56.992570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:56.993010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.033859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] MFA Rules not processed for user `315cdc9dba1e4d94b49d119cd39b6eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:57.033859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.064179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbeea-3648-4a2b-9280-d221d22f8565 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.069830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.070634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.070912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.071185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.071827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.073420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.084107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 892/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:57.084961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.096927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af473-810a-4522-8c45-054bc63ca593 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.101723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.102554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.102724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.103000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.103656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.105574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.114760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 909/1801] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:57.115520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.126166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93e85e-3e60-43e4-991c-ca183bd9c448 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.131729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.132613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.132763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.133310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.133985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.135969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.145838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 893/1802] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:57.145838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.150340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 910/1803] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:57.154450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.165355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103ac9-25ac-4e3e-bfe4-3f2984d0e947 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.169880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:57.230431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520344-7d26-48e3-8f87-331b7ff5bf5b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.241723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.242669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.243314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.244274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.245347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.247461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.275129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:57.282582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.283620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.284113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.284576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.285617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.288102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 894/1804] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:57.288383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.288979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.341145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 911/1805] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:57.342052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.348454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.370026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9e7ad-b52e-4901-93da-f65cfb4dcd23 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.399352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0ef9-d783-4114-ade1-cd6c6a00d674 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.414112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.414972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.418441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.418748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] PATH_INFO: `/v3/projects/435805af2e964c73959e8d23b9e036d2/users/9e0be1d9c92546e79bfa236ea2638bf9/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.440266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435805af2e964c73959e8d23b9e036d2, user_id=9e0be1d9c92546e79bfa236ea2638bf9, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.445354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.450022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.451134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.451639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.452627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] PATH_INFO: `/v3/users/e86084bfaba0451e8a3feeb5a123359b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.455283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86084bfaba0451e8a3feeb5a123359b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.460895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.463795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 895/1806] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:57 2022] PUT /identity/v3/projects/435805af2e964c73959e8d23b9e036d2/users/9e0be1d9c92546e79bfa236ea2638bf9/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:57.465740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.532962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86084bfaba0451e8a3feeb5a123359b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:57.544094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86084bfaba0451e8a3feeb5a123359b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:57.560898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86084bfaba0451e8a3feeb5a123359b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:57.562088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86084bfaba0451e8a3feeb5a123359b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:57.563699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86084bfaba0451e8a3feeb5a123359b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:57.584458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d71b4-34ea-4836-8463-35f6603c19f7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.591605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.591605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.591605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.591605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.592199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.592514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 912/1807] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:57 2022] DELETE /identity/v3/users/e86084bfaba0451e8a3feeb5a123359b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:57.594818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.594933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd609b-a1af-40a7-9224-6caa0e9bef5f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.598170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.623785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 896/1808] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:57.625019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.625304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.625578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.636592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:57.684224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] MFA Rules not processed for user `9e0be1d9c92546e79bfa236ea2638bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:57.687466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.702938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbf35-d7cc-485b-8f94-38aac2b88581 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.710760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.711940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.712713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.713006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.713672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.716807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628124c0-9022-4bdf-be44-1fba8516fbab admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.736169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 913/1809] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:57.737561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.737852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.738125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.765588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:57.767599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.779039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 914/1810] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:57.779039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.779039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.791504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180a2b8-8a80-4a32-ba26-5f37d5601f2b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.798892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.799876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.800000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.800182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.800822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.803017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.817349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 897/1811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:57.818858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.819118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 915/1812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:57.821280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.823370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.826921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:57.839844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee92df-7252-4272-bb1a-d25a5b6d317c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.841366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185cef4-4c6d-4eb5-8639-e3b4acaa52b9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.848243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.848865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.849115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.849305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.849555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.850420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.850525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.851004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.852508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.854048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.855962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.860285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.872637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 898/1813] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:57.876148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.893790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4fa7-e78c-4c9f-a2f9-e30152570b49 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:57.903444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:57.905263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:57.905453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 916/1814] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:57 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:07:57.905932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:57.906504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] PATH_INFO: `/v3/projects/0c1ebb4857944b6888d42d6b5749393b/users/60129c6ee92c4e789b5048099a101acd/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:57.907277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.909172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:57.931302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1ebb4857944b6888d42d6b5749393b, user_id=60129c6ee92c4e789b5048099a101acd, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:57.935238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:57.964548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 899/1815] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:57 2022] PUT /identity/v3/projects/0c1ebb4857944b6888d42d6b5749393b/users/60129c6ee92c4e789b5048099a101acd/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:57.966501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:57.995126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ea08-10e7-4732-9339-e51ab09098bd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.057937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.058598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.058878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.059151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.127924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778eb-e39c-43c2-97c6-1579ab16c2bf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.147003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.148312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.148753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.149194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] PATH_INFO: `/v3/projects/963968644c4c403aa8a25805ea17f0a5/users/f58b5c4cf5384c3391b03a2f264f430c/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.193965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963968644c4c403aa8a25805ea17f0a5, user_id=f58b5c4cf5384c3391b03a2f264f430c, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.198117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.199786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:58.227453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 900/1816] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:57 2022] PUT /identity/v3/projects/963968644c4c403aa8a25805ea17f0a5/users/f58b5c4cf5384c3391b03a2f264f430c/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:58.239691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.262974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.265409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.278258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 917/1817] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:58.279129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.289428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175b78-14b4-4074-bad5-477a7f637626 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.344346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae952b-fcaf-494a-9bcc-731533727903 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.360314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.361094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.361471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.361844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.362634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.365581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.370653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.371615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.372214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.372747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.373578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.376681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bba34-cba3-450d-bedf-2e7894912a0b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.395426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 918/1818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:58.395426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4564-a9d6-4a46-8e09-37c3ee28b70b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.395426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4564-a9d6-4a46-8e09-37c3ee28b70b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.395426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4564-a9d6-4a46-8e09-37c3ee28b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.408232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 901/1819] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:58 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:58.410430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.423952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11048c9-6980-4a9e-95ae-03920687afb9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.429976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.431273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.431858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.432327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] PATH_INFO: `/v3/projects/0c1ebb4857944b6888d42d6b5749393b/users/60129c6ee92c4e789b5048099a101acd/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.435295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1ebb4857944b6888d42d6b5749393b, user_id=60129c6ee92c4e789b5048099a101acd, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.438907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.447451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-774d4564-a9d6-4a46-8e09-37c3ee28b70b None None] MFA Rules not processed for user `f58b5c4cf5384c3391b03a2f264f430c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:58.449333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-774d4564-a9d6-4a46-8e09-37c3ee28b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:58.453861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 902/1820] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:58 2022] PUT /identity/v3/projects/0c1ebb4857944b6888d42d6b5749393b/users/60129c6ee92c4e789b5048099a101acd/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:58.455051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.503171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:58.542796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffc5d7-359e-4685-957c-bded77698a52 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.545358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 919/1821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:58.546722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.547011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.547289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.559073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.559073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.559749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.559832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.562679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.563892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.594441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 903/1822] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:58.594441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.595791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] MFA Rules not processed for user `60129c6ee92c4e789b5048099a101acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:58.597025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:58.607982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53748e7c-9824-4af9-8488-77b3406c9ac8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.613951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.614640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.614922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.615346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.615991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.617956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.654290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 904/1823] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:07:58 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:58.655031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.664710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:58.687550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 920/1824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:58.687934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.699641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0c9f-b5d2-4c54-a618-7db67f506521 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.740696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6cb1-cafe-41fd-8974-35830db80e6b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.745418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.746086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.746399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.746679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] PATH_INFO: `/v3/projects/b3b7697ae64b4a0eb22341396edd70fc/users/c9e8f0698d164f188930a0c96b20b0f0/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.760491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.761147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.761417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.761695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.761855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b7697ae64b4a0eb22341396edd70fc, user_id=c9e8f0698d164f188930a0c96b20b0f0, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.762392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.764301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.765269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.778953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 905/1825] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:58 2022] PUT /identity/v3/projects/b3b7697ae64b4a0eb22341396edd70fc/users/c9e8f0698d164f188930a0c96b20b0f0/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:58.781983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.781983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:58.789639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 921/1826] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:07:58 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:07:58.789639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.789639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:58.853814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dacae8-c319-4021-a4fc-217d72cf8f25 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.865724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345f45-0393-44b8-ad31-0f17becf7aa0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:58.870195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.870995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.871286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.871653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] PATH_INFO: `/v3/projects/2db644e1d9d3454ba6b485a476c71d16` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.872907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db644e1d9d3454ba6b485a476c71d16)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.875629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.909666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:58.909879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:58.910080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:58.910500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:58.910778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:58.928949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db644e1d9d3454ba6b485a476c71d16', 'request_id': 'req-11964784-a16a-497b-abd4-a84095826bdd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:58.937079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db644e1d9d3454ba6b485a476c71d16', 'request_id': 'req-11964784-a16a-497b-abd4-a84095826bdd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:58.942767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db644e1d9d3454ba6b485a476c71d16', 'request_id': 'req-11964784-a16a-497b-abd4-a84095826bdd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:58.953933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] The token cache is being invalidate because project 2db644e1d9d3454ba6b485a476c71d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:07:58.954220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:58.954912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:58.956425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 906/1827] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:07:58 2022] DELETE /identity/v3/projects/2db644e1d9d3454ba6b485a476c71d16 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:58.957190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:58.958514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:58.962950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:58.978466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:58.980134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:58.990596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 922/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:07:58.991489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.002187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab10bd-df70-4724-8058-130cd1b331b1 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.053379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964784-a16a-497b-abd4-a84095826bdd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.059518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.060162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.060441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.060713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.061373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.063711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.076990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 907/1829] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:59.076990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.076990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.079244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.079867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.080148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.080532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.082456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.083009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.092249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a3352-3dcf-4aa8-a9e1-61f7803260ab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.095420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 923/1830] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:59.096317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.098108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.099129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.099571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.099732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] PATH_INFO: `/v3/users/a9d31cae457a43cf9a2f305fdd0c4842` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.101224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d31cae457a43cf9a2f305fdd0c4842)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.106602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.107545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cee5d-7d58-4204-8cdb-86056540188e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.122985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.125241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.125804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.126398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] PATH_INFO: `/v3/projects/b3b7697ae64b4a0eb22341396edd70fc/users/c9e8f0698d164f188930a0c96b20b0f0/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.128800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b7697ae64b4a0eb22341396edd70fc, user_id=c9e8f0698d164f188930a0c96b20b0f0, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.132418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.167833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 924/1831] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:59 2022] PUT /identity/v3/projects/b3b7697ae64b4a0eb22341396edd70fc/users/c9e8f0698d164f188930a0c96b20b0f0/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:59.167833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.167833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.196260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d31cae457a43cf9a2f305fdd0c4842'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.197609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d31cae457a43cf9a2f305fdd0c4842'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.206964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d31cae457a43cf9a2f305fdd0c4842'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.231956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d31cae457a43cf9a2f305fdd0c4842'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.233263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e1c20c58-ef23-411e-96c3-bb457cc4d9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d31cae457a43cf9a2f305fdd0c4842'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.271962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 908/1832] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:59 2022] DELETE /identity/v3/users/a9d31cae457a43cf9a2f305fdd0c4842 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:59.273829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.274113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.274413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.300540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cc75-167c-4372-9718-6aeaefacb3bd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.335617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] MFA Rules not processed for user `c9e8f0698d164f188930a0c96b20b0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:59.337343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.362944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:59.388140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.388984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.389368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.389780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] PATH_INFO: `/v3/projects/b22815fba66042bd95b6c5391c9bf231/users/399becaab50b4f2e8d0d90505c833e6c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.414001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22815fba66042bd95b6c5391c9bf231, user_id=399becaab50b4f2e8d0d90505c833e6c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.417702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.431678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:59.454180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 925/1833] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:59 2022] PUT /identity/v3/projects/b22815fba66042bd95b6c5391c9bf231/users/399becaab50b4f2e8d0d90505c833e6c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:59.454364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 909/1834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:07:59.460584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.462407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.472031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.474537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.607835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668e1a-c5e2-498c-a785-103d3e87c9ae admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.612753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674b8c-2360-48aa-b2c4-14cad1eae4af None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.619193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.621612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.621965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.622562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.625158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.630848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.658490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 926/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:07:59.659381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.661494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.682134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633eb81-ca23-4646-ad5a-dc009d2262b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.687120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.688106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.688393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.688669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] PATH_INFO: `/v3/users/315cdc9dba1e4d94b49d119cd39b6eaa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.690720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] RBAC: Authorizing `identity:delete_user(user_id=315cdc9dba1e4d94b49d119cd39b6eaa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.692819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.706003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.706656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.706942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.707214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.753762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315cdc9dba1e4d94b49d119cd39b6eaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.762147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315cdc9dba1e4d94b49d119cd39b6eaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.777839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315cdc9dba1e4d94b49d119cd39b6eaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.778596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315cdc9dba1e4d94b49d119cd39b6eaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.779564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315cdc9dba1e4d94b49d119cd39b6eaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:07:59.786466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.788285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea28e6-4b43-4593-a180-1a6db80309de service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.797032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 927/1836] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:07:59 2022] DELETE /identity/v3/users/315cdc9dba1e4d94b49d119cd39b6eaa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:59.799328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.799973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 910/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:07:59.801205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.801596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.801875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.802716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.826024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:07:59.827448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.838369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:59.896620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 911/1838] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:07:59.899862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.899862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:07:59.900240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a37b-5718-48d5-b2c5-4d89923b23db admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:07:59.907312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:07:59.907993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:07:59.908449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:07:59.908738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] PATH_INFO: `/v3/projects/b22815fba66042bd95b6c5391c9bf231/users/399becaab50b4f2e8d0d90505c833e6c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:07:59.911596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22815fba66042bd95b6c5391c9bf231, user_id=399becaab50b4f2e8d0d90505c833e6c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:07:59.914749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:07:59.922820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:07:59.930825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 928/1839] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:07:59 2022] PUT /identity/v3/projects/b22815fba66042bd95b6c5391c9bf231/users/399becaab50b4f2e8d0d90505c833e6c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:07:59.934043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:07:59.939685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.006961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bc0a9-cb45-4114-9871-28192cfecd7a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.020786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ad72-efb6-4136-8eed-917c538ebc76 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.024483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.025091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.025364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.025633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.060254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.060864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.061149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.061451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.063226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.087796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.089236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fea09-f5c1-4393-b410-48a6e027e897 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.099265 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 929/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:00.100473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.100754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.101023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.124904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.126593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.134289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] MFA Rules not processed for user `399becaab50b4f2e8d0d90505c833e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:00.135730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.137042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 912/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:00.139190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:00.141207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.161483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec704c4-c8d4-4a1e-a2dc-fd2b09ca161a service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.171553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.172600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.172873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.173133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] PATH_INFO: `/v3/projects/46e3281b75a54aba9e6aa22d226652fa` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.174742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e3281b75a54aba9e6aa22d226652fa)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.179385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.211228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:00.224593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 930/1842] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:00.233311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:00.235620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.247748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d439-6e77-492a-b8cc-1902f4c98795 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.251915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e3281b75a54aba9e6aa22d226652fa', 'request_id': 'req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:00.262418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e3281b75a54aba9e6aa22d226652fa', 'request_id': 'req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:00.275715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e3281b75a54aba9e6aa22d226652fa', 'request_id': 'req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:00.292333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:00.307800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] The token cache is being invalidate because project 46e3281b75a54aba9e6aa22d226652fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:00.308791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:00.310174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80a2abc5-f3e3-4609-94c5-39cc8f487f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:00.313578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 913/1843] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:00 2022] DELETE /identity/v3/projects/46e3281b75a54aba9e6aa22d226652fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:00.319003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.319515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.320514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.331016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.332871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.332871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.332871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.336213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.390160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:00.398720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.503116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.504863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ba7b1-dc6a-4a7d-a2cd-92f9591f49ae service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.530925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 931/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:00.586977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 914/1845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:00.589800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.590357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.590869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.621220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:00.622917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.673725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:00.681550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 932/1846] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:00.730641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a780-5318-4311-952a-d0ac1ccbfdd4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.767619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.767619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.767619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.767619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.768989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:00.772904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.776893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.838888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:00.852895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:00.871816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 915/1847] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:08:00.873833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:00.874837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e7af0-0c2c-431c-8535-62b13177bfc0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.888313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.889465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.889893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.890252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] PATH_INFO: `/v3/users/f58b5c4cf5384c3391b03a2f264f430c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.893574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58b5c4cf5384c3391b03a2f264f430c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.900952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.904647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6b23-ae80-4bc7-83c7-a7db1163d89d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:00.917386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:00.918091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:00.918574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:00.918851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:00.919745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:00.923531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:00.966780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 916/1848] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:00 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:00.999784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.016477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58b5c4cf5384c3391b03a2f264f430c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.039560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58b5c4cf5384c3391b03a2f264f430c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.075544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58b5c4cf5384c3391b03a2f264f430c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.078094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58b5c4cf5384c3391b03a2f264f430c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.078935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd3c75d-b87e-44be-86ce-50a258c91774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58b5c4cf5384c3391b03a2f264f430c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.105116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 933/1849] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:00 2022] DELETE /identity/v3/users/f58b5c4cf5384c3391b03a2f264f430c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:01.105774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769ac1-726e-4f44-a00c-f73200b81fe1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.110079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.110654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.110654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.137739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:01.157478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:01.161426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.193819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.194374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.194651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.194923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.195553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.197475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.255793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:01.269458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 917/1850] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:00 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:01.273177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.277561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.289748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 934/1851] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:01.289748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.289748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.306174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83e22-795a-42cb-ab08-55a5a533255c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.309790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21fc18-d323-4d68-92f5-e96da6a4a564 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.311921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.312879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.313159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.313538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.314312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.316509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.316801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.318206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.318523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.319162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] PATH_INFO: `/v3/projects/3438943fbca541a18545ad9672e3fc8e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.320366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3438943fbca541a18545ad9672e3fc8e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.323475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.336691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 935/1852] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:01.338038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.349942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90f53-d860-4c4a-b3b8-9f5a64737a03 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.355303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.356135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.356430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.356709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.357367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.359417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.373755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 936/1853] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:01.377880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.391159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcea77-057d-422a-a2f8-80589082af1a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.401371 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3438943fbca541a18545ad9672e3fc8e', 'request_id': 'req-bd5da1ff-bda6-4c2e-b593-838cae943189'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.412879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3438943fbca541a18545ad9672e3fc8e', 'request_id': 'req-bd5da1ff-bda6-4c2e-b593-838cae943189'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.421567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3438943fbca541a18545ad9672e3fc8e', 'request_id': 'req-bd5da1ff-bda6-4c2e-b593-838cae943189'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.437536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] The token cache is being invalidate because project 3438943fbca541a18545ad9672e3fc8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:01.437723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.438525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.440069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 918/1854] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:01 2022] DELETE /identity/v3/projects/3438943fbca541a18545ad9672e3fc8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:01.442990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.442990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.474968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.475654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.475933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.476206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] PATH_INFO: `/v3/projects/bdf8bc3fda6842e8adfeeebaaa606d82/users/17b22881f1414157af7e3809fa2ad276/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.517378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf8bc3fda6842e8adfeeebaaa606d82, user_id=17b22881f1414157af7e3809fa2ad276, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.520837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da1ff-bda6-4c2e-b593-838cae943189 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.521487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.525075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.526020 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.526520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.526879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.529153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.545253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.545455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 937/1855] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:01 2022] PUT /identity/v3/projects/bdf8bc3fda6842e8adfeeebaaa606d82/users/17b22881f1414157af7e3809fa2ad276/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:01.546743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.547070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e7b6f-8366-44ca-9ee4-197dc6e146e6 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.548861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.562820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 919/1856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:01.564574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.565016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.565557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.619918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] MFA Rules not processed for user `17b22881f1414157af7e3809fa2ad276`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:01.621304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.656985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:01.693796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282df66e-e9cb-458a-bc16-66fee2717b18 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.700728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.703075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.704052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.704714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] PATH_INFO: `/v3/users/60129c6ee92c4e789b5048099a101acd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.707490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60129c6ee92c4e789b5048099a101acd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.711755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.757911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 920/1857] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:01.763198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.768784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:01.828061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60129c6ee92c4e789b5048099a101acd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.836358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:01.839009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60129c6ee92c4e789b5048099a101acd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.859623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a59f-8457-4b89-b26f-97c8450edcf2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:01.869007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:01.869684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:01.869963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:01.870235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:01.870905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:01.874675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:01.882820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60129c6ee92c4e789b5048099a101acd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.883601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60129c6ee92c4e789b5048099a101acd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.884284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60129c6ee92c4e789b5048099a101acd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:01.909374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 938/1858] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:01 2022] DELETE /identity/v3/users/60129c6ee92c4e789b5048099a101acd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:01.954693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 921/1859] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:01 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:01.959001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:01.960307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:02.098881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e2a8-d92a-4373-98c4-d558ba2da9cb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.240380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.241343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.241575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.242248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.242935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.245288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.277589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 939/1860] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:01 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:02.281568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.297594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7807-ce42-4384-af4c-b5f448fc8040 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.304873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.306171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.306701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.307467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.308324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.310730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.330517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 922/1861] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:02.331514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.354367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa12-6486-4e83-911c-1dd47173397e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.368448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.371446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.371824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.372138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] PATH_INFO: `/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef/users/0e015306c6f143c1847dabf55a943233/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.407453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a06733c39e4c8da0ae85ea0574c1ef, user_id=0e015306c6f143c1847dabf55a943233, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.412420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.430099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 940/1862] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:02 2022] PUT /identity/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef/users/0e015306c6f143c1847dabf55a943233/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:02.434391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.446796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7948a99-f37c-4cce-b06e-caf6b07ba14d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.553796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.555218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.555218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.555425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.556059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.557916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.574972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 923/1863] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:02.579749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.596313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4669d-a04f-451a-9a56-98400231b881 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.626183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.626183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.626474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.627088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] PATH_INFO: `/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef/users/0e015306c6f143c1847dabf55a943233/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.629532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a06733c39e4c8da0ae85ea0574c1ef, user_id=0e015306c6f143c1847dabf55a943233, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.632599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caba89c-d947-48a2-9842-dba8aa2e4a13 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.649227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 941/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:02 2022] PUT /identity/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef/users/0e015306c6f143c1847dabf55a943233/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:02.652799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.656335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:02.667099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.667441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.667750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.676202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62009e27-d0d9-4943-8d9c-c026f874ef87 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.722990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] MFA Rules not processed for user `0e015306c6f143c1847dabf55a943233`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:02.724321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:02.749800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:02.763998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.765448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.765782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.766061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] PATH_INFO: `/v3/projects/963968644c4c403aa8a25805ea17f0a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.767396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963968644c4c403aa8a25805ea17f0a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.771449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:02.816331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:02.836043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 942/1865] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:02.837016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.838437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:02.847702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963968644c4c403aa8a25805ea17f0a5', 'request_id': 'req-b660563c-a4e2-450f-8d75-3201c59b1194'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:02.858812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963968644c4c403aa8a25805ea17f0a5', 'request_id': 'req-b660563c-a4e2-450f-8d75-3201c59b1194'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:02.860202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f26a7-854f-4793-a085-5d9507009f5d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:02.882581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963968644c4c403aa8a25805ea17f0a5', 'request_id': 'req-b660563c-a4e2-450f-8d75-3201c59b1194'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:02.913299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] The token cache is being invalidate because project 963968644c4c403aa8a25805ea17f0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:02.913723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:02.916386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:02.922339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 924/1866] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:02 2022] DELETE /identity/v3/projects/963968644c4c403aa8a25805ea17f0a5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:02.922339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:02.925892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:02.937548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:02.939080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:02.940093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:02.940474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] PATH_INFO: `/v3/projects/0c1ebb4857944b6888d42d6b5749393b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:02.942090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1ebb4857944b6888d42d6b5749393b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:02.944555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.027341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1ebb4857944b6888d42d6b5749393b', 'request_id': 'req-593af46b-cc49-49dd-a328-6d4ebf4d2151'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.042866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1ebb4857944b6888d42d6b5749393b', 'request_id': 'req-593af46b-cc49-49dd-a328-6d4ebf4d2151'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.062508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1ebb4857944b6888d42d6b5749393b', 'request_id': 'req-593af46b-cc49-49dd-a328-6d4ebf4d2151'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.090378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] The token cache is being invalidate because project 0c1ebb4857944b6888d42d6b5749393b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:03.090679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.092236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.092369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660563c-a4e2-450f-8d75-3201c59b1194 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.096078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 943/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:02 2022] DELETE /identity/v3/projects/0c1ebb4857944b6888d42d6b5749393b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:03.099023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.105634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.168657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.169285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.172022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.172313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.176316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.248323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:03.266710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af46b-cc49-49dd-a328-6d4ebf4d2151 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.273933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.274925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.275679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.276174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] PATH_INFO: `/v3/users/399becaab50b4f2e8d0d90505c833e6c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.277542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=399becaab50b4f2e8d0d90505c833e6c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.282824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.311294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.312881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f900cc-359f-474b-9b79-a5d8207b273e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.334395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 925/1868] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:03.336312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1eb81-a184-441a-b201-83e67860562d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.336829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1eb81-a184-441a-b201-83e67860562d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.337302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1eb81-a184-441a-b201-83e67860562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.372494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399becaab50b4f2e8d0d90505c833e6c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.387482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-56f1eb81-a184-441a-b201-83e67860562d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:03.388718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-56f1eb81-a184-441a-b201-83e67860562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.405918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 926/1869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:03.405918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd43-036e-45e9-8251-8c94265cfac8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.405918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd43-036e-45e9-8251-8c94265cfac8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.405918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd43-036e-45e9-8251-8c94265cfac8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.405918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 927/1870] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:08:03.408671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.409402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399becaab50b4f2e8d0d90505c833e6c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.410717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.411008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.425237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399becaab50b4f2e8d0d90505c833e6c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.425977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399becaab50b4f2e8d0d90505c833e6c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.426680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5f1ff01-3722-4c51-91da-d1fdbd5d0fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399becaab50b4f2e8d0d90505c833e6c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:03.448375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 944/1871] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:03 2022] DELETE /identity/v3/users/399becaab50b4f2e8d0d90505c833e6c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:03.451331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.451331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.451628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.461382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:03.462403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.486124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:03.488166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.492049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:03.615510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 928/1872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:03.620381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.643640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 945/1873] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:03.645596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2bd6-be18-4182-9f88-027522eb65ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.652540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.653603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.654673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.654951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.656189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:03.656496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.658866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.682583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 929/1874] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:03.687609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.711311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9ccb6-dfc7-4abd-88c8-7593f01311e6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.718862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.721562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.721893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.722187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.722938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.725969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.767558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.770595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.790666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f77d60-0e34-4ca4-9695-7400ccbcc7ec admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.794611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 946/1875] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:03 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:03.797578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.847859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:03.877046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480818-264e-43d7-9c95-1a62c9025fb9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:03.882748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.883496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.883837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.884168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.885000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.887321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:03.944257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 947/1876] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:03 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:03.945268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:03.947535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:03.958882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:03.959916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:03.960040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:03.960302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] PATH_INFO: `/v3/users/608794369f41467ca150ddc9c5f7f78d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:03.964647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608794369f41467ca150ddc9c5f7f78d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:03.969169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.073508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c35-4cf3-462f-aaa7-180c12ea90e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.081064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608794369f41467ca150ddc9c5f7f78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.081918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608794369f41467ca150ddc9c5f7f78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.086696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.088528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.089163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.089774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.094670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608794369f41467ca150ddc9c5f7f78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.097523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.114090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.116627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608794369f41467ca150ddc9c5f7f78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.116793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.117311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608794369f41467ca150ddc9c5f7f78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.131740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 948/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:04.132504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.133994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.161751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4656-af24-4d86-b0cd-e388172076ee service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.167304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 930/1878] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:03 2022] DELETE /identity/v3/users/608794369f41467ca150ddc9c5f7f78d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:04.169729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.175134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.232587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:04.273304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.274213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.274744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.274922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.275573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.278055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f059c-5111-4974-aa73-51773ce89cd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.321382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 949/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:04.324683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.324969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.325241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.332353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e2dd-271b-4d68-9a41-2006badb9e63 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.345357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.346782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.347171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.347518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] PATH_INFO: `/v3/users/17b22881f1414157af7e3809fa2ad276` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.349163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b22881f1414157af7e3809fa2ad276)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.352169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.378074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:04.379749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.392907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 950/1880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:04.392907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.393848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.408796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6493-72b8-41b3-a202-68db6c489ad5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.416805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.417456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.417729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.418006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] PATH_INFO: `/v3/projects/b22815fba66042bd95b6c5391c9bf231` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.419192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22815fba66042bd95b6c5391c9bf231)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.422127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.426186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b22881f1414157af7e3809fa2ad276'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.426966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b22881f1414157af7e3809fa2ad276'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.435755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b22881f1414157af7e3809fa2ad276'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.452678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b22881f1414157af7e3809fa2ad276'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.453509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b22881f1414157af7e3809fa2ad276'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.474349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 931/1881] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:04 2022] DELETE /identity/v3/users/17b22881f1414157af7e3809fa2ad276 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:04.474349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.474622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.483919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:04.499354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22815fba66042bd95b6c5391c9bf231', 'request_id': 'req-47053683-78b7-4946-9618-12c34edcb51a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.509975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22815fba66042bd95b6c5391c9bf231', 'request_id': 'req-47053683-78b7-4946-9618-12c34edcb51a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.522832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22815fba66042bd95b6c5391c9bf231', 'request_id': 'req-47053683-78b7-4946-9618-12c34edcb51a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.537904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] The token cache is being invalidate because project b22815fba66042bd95b6c5391c9bf231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:04.538410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.539355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:04.541948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 951/1882] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:04 2022] DELETE /identity/v3/projects/b22815fba66042bd95b6c5391c9bf231 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:04.543667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.548987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.620413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d03a3-1744-41e6-8d12-89fb700b848b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.681538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053683-78b7-4946-9618-12c34edcb51a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.684545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:04.686886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.687862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.688250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.688589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.691408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.709676 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.710333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.711858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.712344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.713031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.718343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c53b6-e864-4db4-9ad0-5c5db0699a21 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.748788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 932/1883] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:04.753992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5e3-6693-486a-a6ec-2d8f9a11ac48 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.754203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5e3-6693-486a-a6ec-2d8f9a11ac48 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.754575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5e3-6693-486a-a6ec-2d8f9a11ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.775302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89f8f5e3-6693-486a-a6ec-2d8f9a11ac48 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:04.776524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89f8f5e3-6693-486a-a6ec-2d8f9a11ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.782309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.784244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.789208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 933/1884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:04.789208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.789208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.789208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.796370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 952/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:04.798200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.799697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.812966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:04.814564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.815072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ebef-6a49-4e65-9a99-2cfb32fd1b2f service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.820536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.821199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.821479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.821751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] PATH_INFO: `/v3/projects/cff1b835171f4550b2f96d45be4afebc/users/89713cefba434585912812fbd9764500/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.826555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 934/1886] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:04.828385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:04.848091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f55f7-a1a8-4366-a3b5-766766855b2f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:04.848460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff1b835171f4550b2f96d45be4afebc, user_id=89713cefba434585912812fbd9764500, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.852397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066c79b-bf60-4c9f-82aa-88b3d04cb629 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.854630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:04.855664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.856284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.856791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.869884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 953/1887] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:04 2022] PUT /identity/v3/projects/cff1b835171f4550b2f96d45be4afebc/users/89713cefba434585912812fbd9764500/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:04.878705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:04.878705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a1036-337f-448b-a7c7-c72dc2a36957 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:04.880410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.883542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.883542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.889571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 935/1888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:04.891014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:04.891555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:04.891843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:04.913482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:04.915131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.942905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] MFA Rules not processed for user `89713cefba434585912812fbd9764500`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:04.944158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:04.998532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:05.025450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 954/1889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:05.030909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.044567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440bc5-4a0f-4c13-892d-dcd30cbfcc3c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.052266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.053847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.054624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.055113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.056197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:05.056749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.059454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.082577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 936/1890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:05.087147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.107057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 955/1891] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:08:05.107989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.111216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce777ea4-2b2d-4500-8157-92088fc0fd25 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.116712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.117335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.117615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.117885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.118694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.121246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.129346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d351eb-e553-4cd7-b157-3f50043f0f5b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.138065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.138710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.139063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.139355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.140912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.143275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.166931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 937/1892] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:05 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:05.172440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.195050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 956/1893] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:05 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:05.202878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.314445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ff055-253f-44d6-a8eb-8d7039b54605 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.322476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.323214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.323635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.324004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.324916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.327918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.341846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ae0c-2310-41e6-b5d3-73755f7e58fb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.353292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.353894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.354338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.354619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.355560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.362525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.374920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 957/1894] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:05 2022] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:05.376323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.378794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.399054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c789949-d305-4a7a-84a8-c322d392920b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.410723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.412017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.412017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.412017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] PATH_INFO: `/v3/projects/e595e4d255ad47a29056f78289c00c74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.417114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 938/1895] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:05 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:05.417114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.423410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e595e4d255ad47a29056f78289c00c74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.425830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.435974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95fa95-0243-4417-a6f7-7be1b870e40d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.444951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.445585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.445870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.446144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.446844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.448528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.464823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 939/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:05.465835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.482369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9dbb-716b-425d-8fbf-2d200ca8afe6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.489439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:05.508630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e595e4d255ad47a29056f78289c00c74', 'request_id': 'req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.528364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e595e4d255ad47a29056f78289c00c74', 'request_id': 'req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.547252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e595e4d255ad47a29056f78289c00c74', 'request_id': 'req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.565958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] The token cache is being invalidate because project e595e4d255ad47a29056f78289c00c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:05.566178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.567070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.569091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 958/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:05 2022] DELETE /identity/v3/projects/e595e4d255ad47a29056f78289c00c74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:05.569641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.572895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.576722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.577375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.577872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.577981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.578738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.580477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.588870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c63ce-f70e-4b65-bc52-7c4aa19d5133 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.594446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.595019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 940/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:05.595172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.595860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.595860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.596044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.596328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.597603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.598144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.612409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31821-c594-4f5e-8625-b2a76b423ea1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.618188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.618964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.619343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.619737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] PATH_INFO: `/v3/projects/bdf8bc3fda6842e8adfeeebaaa606d82` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.622154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 959/1899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:05.623270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.626997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.637262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf8bc3fda6842e8adfeeebaaa606d82)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.643109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.649665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6c402-84e6-426c-8c72-962d959bcd01 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.656999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.658547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.659149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.659740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] PATH_INFO: `/v3/users/9e0be1d9c92546e79bfa236ea2638bf9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.661356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0be1d9c92546e79bfa236ea2638bf9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.664476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.680759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:05.741519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf8bc3fda6842e8adfeeebaaa606d82', 'request_id': 'req-e420552c-a183-4d82-8e55-7c6e7b3c17a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.748873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0be1d9c92546e79bfa236ea2638bf9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.753656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf8bc3fda6842e8adfeeebaaa606d82', 'request_id': 'req-e420552c-a183-4d82-8e55-7c6e7b3c17a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.757845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0be1d9c92546e79bfa236ea2638bf9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.761886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf8bc3fda6842e8adfeeebaaa606d82', 'request_id': 'req-e420552c-a183-4d82-8e55-7c6e7b3c17a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.775970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0be1d9c92546e79bfa236ea2638bf9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.777007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0be1d9c92546e79bfa236ea2638bf9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.777690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0be1d9c92546e79bfa236ea2638bf9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.777983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] The token cache is being invalidate because project bdf8bc3fda6842e8adfeeebaaa606d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:05.778299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.779271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:05.782538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 941/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:05 2022] DELETE /identity/v3/projects/bdf8bc3fda6842e8adfeeebaaa606d82 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:05.783333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.786547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.800058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 960/1901] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:05 2022] DELETE /identity/v3/users/9e0be1d9c92546e79bfa236ea2638bf9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:05.800775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:05.802185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:05.881454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420552c-a183-4d82-8e55-7c6e7b3c17a5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.941133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:05.949382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e32-ae9a-4c95-b084-e9e5e069ca55 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:05.955800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.956515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.956804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.957217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] PATH_INFO: `/v3/projects/9306300b22454734b3f81606bd474be7/users/e187bd6e25eb4bf29bbe52deaa6ae9d9/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:05.977051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9306300b22454734b3f81606bd474be7, user_id=e187bd6e25eb4bf29bbe52deaa6ae9d9, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:05.979779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:05.993365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:05.994047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:05.994365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:05.994640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] PATH_INFO: `/v3/projects/917010dcd5734895b32a12f453599d5d/users/e95571f1da8c46fdbcd0e2a0bf392d03/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.008825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 961/1902] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:05 2022] PUT /identity/v3/projects/9306300b22454734b3f81606bd474be7/users/e187bd6e25eb4bf29bbe52deaa6ae9d9/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.009800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.018224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.019071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=917010dcd5734895b32a12f453599d5d, user_id=e95571f1da8c46fdbcd0e2a0bf392d03, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.022259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1642eb-4e64-4236-8151-b4f8ea187c3e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.039848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 942/1903] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:05 2022] PUT /identity/v3/projects/917010dcd5734895b32a12f453599d5d/users/e95571f1da8c46fdbcd0e2a0bf392d03/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.041155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.041430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.041698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.074960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] MFA Rules not processed for user `e187bd6e25eb4bf29bbe52deaa6ae9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:06.076673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.113377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8afd7-46fd-4284-90c1-66238576c384 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.126218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:06.148926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 943/1904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:06.150298 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.195957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.196990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.197248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.198610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] PATH_INFO: `/v3/users/0e015306c6f143c1847dabf55a943233` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.200967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e015306c6f143c1847dabf55a943233)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.204454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.227795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865e3d-9407-4977-bf90-3dd05272571a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.232435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.233103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.233877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.234285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.234926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.236776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.252395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 944/1905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:06.252395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.252395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.267878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e420d-0263-47fa-8c75-03851090c811 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.268009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e015306c6f143c1847dabf55a943233'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.274290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.274745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.275024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.275293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.275918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.277231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e015306c6f143c1847dabf55a943233'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.278416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.290552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e015306c6f143c1847dabf55a943233'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.291313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e015306c6f143c1847dabf55a943233'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.291968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e015306c6f143c1847dabf55a943233'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.312473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 962/1906] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:06 2022] DELETE /identity/v3/users/0e015306c6f143c1847dabf55a943233 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.312473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.312473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.320796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 945/1907] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:06 2022] POST /identity/v3/projects => generated 409 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:06.320796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.322959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.352602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:06.399190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053079e3-ba04-4a93-9611-dcf5e15f7352 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.417849 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291e707-27ad-4dd4-b694-1802d7fe183d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.424316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.425534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.425989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.426454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] PATH_INFO: `/v3/projects/917010dcd5734895b32a12f453599d5d/users/e95571f1da8c46fdbcd0e2a0bf392d03/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.429881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=917010dcd5734895b32a12f453599d5d, user_id=e95571f1da8c46fdbcd0e2a0bf392d03, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.434640 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.452662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:06.473827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 946/1908] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:06 2022] PUT /identity/v3/projects/917010dcd5734895b32a12f453599d5d/users/e95571f1da8c46fdbcd0e2a0bf392d03/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.473827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.473827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.484351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.487276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.488454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.488641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] PATH_INFO: `/v3/projects/435805af2e964c73959e8d23b9e036d2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.492390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435805af2e964c73959e8d23b9e036d2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.494409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.589163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435805af2e964c73959e8d23b9e036d2', 'request_id': 'req-c4e403ac-795a-4537-ac86-e28b9279dc68'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.599918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e9558-9d53-4642-ba4a-b636d8860b0b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.600128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435805af2e964c73959e8d23b9e036d2', 'request_id': 'req-c4e403ac-795a-4537-ac86-e28b9279dc68'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.609016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435805af2e964c73959e8d23b9e036d2', 'request_id': 'req-c4e403ac-795a-4537-ac86-e28b9279dc68'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.623079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] The token cache is being invalidate because project 435805af2e964c73959e8d23b9e036d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:06.623481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.625895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c4e403ac-795a-4537-ac86-e28b9279dc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.633166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 963/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:06 2022] DELETE /identity/v3/projects/435805af2e964c73959e8d23b9e036d2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.633166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.633166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.633166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.669376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.669990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.670285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.670761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.671395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.673524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.678405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] MFA Rules not processed for user `e95571f1da8c46fdbcd0e2a0bf392d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:06.680189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.706157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 947/1910] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:06 2022] POST /identity/v3/users => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:06.707023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.708680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.721808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10015441-8415-4971-9cc5-82e4a3b027e5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.727844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.728454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.728731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.729002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] PATH_INFO: `/v3/users/c9e8f0698d164f188930a0c96b20b0f0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.730216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e8f0698d164f188930a0c96b20b0f0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.732354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.791491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 964/1911] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:06.804383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.806566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.813293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:06.815848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e8f0698d164f188930a0c96b20b0f0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.817261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e8f0698d164f188930a0c96b20b0f0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.826529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e8f0698d164f188930a0c96b20b0f0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.844623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e8f0698d164f188930a0c96b20b0f0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.846036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e8f0698d164f188930a0c96b20b0f0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:06.869570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12064c3a-5b4b-49a2-92bd-1d8bcd6627cd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.872227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 948/1912] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:06 2022] DELETE /identity/v3/users/c9e8f0698d164f188930a0c96b20b0f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:06.873168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.874697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.895661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.897011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.898238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.898957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.901552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:06.917626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:06.946001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 965/1913] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:06.951795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:06.955743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:06.982462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4217a-53a0-4b6c-815a-9ec6575918a0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.985438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9fad-de6a-4eef-a074-6797f5ed4bc5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:06.989831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:06.990487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:06.990764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:06.991029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:06.997388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.120572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:07.147694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.148372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.148653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.148932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] PATH_INFO: `/v3/projects/4781673a4ac14575a54a77abdf7b640a/users/f271f8f2873c41be9ad2eace3eba513c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.156638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.158772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.169636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4781673a4ac14575a54a77abdf7b640a, user_id=f271f8f2873c41be9ad2eace3eba513c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.172367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.177838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 949/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:07.185717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.187509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.193970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 966/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:06 2022] PUT /identity/v3/projects/4781673a4ac14575a54a77abdf7b640a/users/f271f8f2873c41be9ad2eace3eba513c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:07.197548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.205931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cdeed-6e5b-481a-b4c8-43f65bbbe6f5 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.285988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5969-e2e6-4574-b849-e5cfa534a38c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.290981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.291632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.291908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.292183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.292926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.294797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.311924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 967/1916] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:07.315846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.328568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.328993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193879-f3f0-4e93-b4bd-bbe4ceb4bba9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.329236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.329518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.329852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] PATH_INFO: `/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.331588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a06733c39e4c8da0ae85ea0574c1ef)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.333843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.334622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.334882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.335548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] PATH_INFO: `/v3/projects/4781673a4ac14575a54a77abdf7b640a/users/f271f8f2873c41be9ad2eace3eba513c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.336921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.337517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4781673a4ac14575a54a77abdf7b640a, user_id=f271f8f2873c41be9ad2eace3eba513c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.340832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cc70c-9c2d-48ca-b87d-d2e9d2f96791 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.358724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 968/1917] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:07 2022] PUT /identity/v3/projects/4781673a4ac14575a54a77abdf7b640a/users/f271f8f2873c41be9ad2eace3eba513c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:07.367354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.367805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.368192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.399679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:07.414891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] MFA Rules not processed for user `f271f8f2873c41be9ad2eace3eba513c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:07.416946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.488026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a06733c39e4c8da0ae85ea0574c1ef', 'request_id': 'req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.501011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a06733c39e4c8da0ae85ea0574c1ef', 'request_id': 'req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.514317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a06733c39e4c8da0ae85ea0574c1ef', 'request_id': 'req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.531391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] The token cache is being invalidate because project c7a06733c39e4c8da0ae85ea0574c1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:07.531693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.532454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c1fabfb4-d59d-4fa9-9bf5-b64467a4fca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.535586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 950/1918] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:07 2022] DELETE /identity/v3/projects/c7a06733c39e4c8da0ae85ea0574c1ef => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:07.540403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.540768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.541477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.551129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 969/1919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:07.566795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.568589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.572115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:07.574390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.637699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:07.659123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be3856-ce5c-4965-adf7-dd3b44496188 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.666422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 951/1920] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:07.667553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.669095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.684521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4d77-ca3a-4d95-9e8c-a73d32df9d22 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.690596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.691568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.691914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.692307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] PATH_INFO: `/v3/projects/b3b7697ae64b4a0eb22341396edd70fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.693591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b7697ae64b4a0eb22341396edd70fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.695537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.731372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.732295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.732610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.732991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.736424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.753583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b7697ae64b4a0eb22341396edd70fc', 'request_id': 'req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.767590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b7697ae64b4a0eb22341396edd70fc', 'request_id': 'req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.778689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b7697ae64b4a0eb22341396edd70fc', 'request_id': 'req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.792244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] The token cache is being invalidate because project b3b7697ae64b4a0eb22341396edd70fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:07.792551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.793225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1d942b4-5d72-4585-bff7-1cc91bdf17cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:07.795002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 952/1921] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:07 2022] DELETE /identity/v3/projects/b3b7697ae64b4a0eb22341396edd70fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:07.800705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.801286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.801286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.823269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:07.824536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.829137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.830656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62775cce-aa7c-49e5-b3cf-6211d6411ab5 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.840956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 970/1922] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:07.842386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770def1c-e212-4e84-92f1-01dcd01ccda4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.842676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770def1c-e212-4e84-92f1-01dcd01ccda4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.842971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770def1c-e212-4e84-92f1-01dcd01ccda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.855051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:07.865665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-770def1c-e212-4e84-92f1-01dcd01ccda4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:07.867185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-770def1c-e212-4e84-92f1-01dcd01ccda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:07.901744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 953/1923] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:07.919918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:07.946326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 971/1924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:07.949650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2534-b2fe-40e0-997e-239bbb24a961 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:07.957360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:07.959792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796243-4367-4682-a655-3d996ba8069d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.960255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796243-4367-4682-a655-3d996ba8069d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.960347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796243-4367-4682-a655-3d996ba8069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.963177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:07.966675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:07.969788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:07.978652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:07.980389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:07.985999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8e796243-4367-4682-a655-3d996ba8069d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:07.987372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:07.987680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8e796243-4367-4682-a655-3d996ba8069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:08.001930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 972/1925] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:08.004745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796243-4367-4682-a655-3d996ba8069d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.015005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 954/1926] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:08:08.019871 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.021118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796243-4367-4682-a655-3d996ba8069d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.048189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.048944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.049755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.050720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.052884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:08.053267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.055771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb467d-cf68-4e40-922e-1f63ddecb5d6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.059067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.064106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.065165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.065632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.066300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.066962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.069172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.081079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 973/1927] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:08.081878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.083675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:08.115857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 955/1928] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:08.116755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.132270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:08.164772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb19ef-2010-4197-b67c-1a76fc0c2153 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.197634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f48a-c74e-41b8-9b88-260b809bdec7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.204130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.204789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.205066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.205333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.205990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.208044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.225087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.225851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.226171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.226521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.228747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:08.238092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 956/1929] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:08.242103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.303055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.305055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.317559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 974/1930] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:08.318786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.321126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc6462-a126-44e8-ac49-5176e5c8af4c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.328519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.329216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.329561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.329898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.330643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.331146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ceaa1-328c-48f0-a489-b4b453daddf5 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.333176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.336435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.337039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.337401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.337675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.338330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.340233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.368243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 957/1931] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:08.369201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.371862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 975/1932] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:08.376686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.384757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced83a-9c94-402b-98b4-d93714ae59cc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.391076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df636ad-8150-492a-9cd2-0ac9af1ec049 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.392366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.393075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.393359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.393632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.394567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.396692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.399041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.399780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.400387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.400689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.401449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.403158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.406072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:08.416475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 958/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:08.417410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.420974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 976/1934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:08.422459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.435470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6540-1f24-48fb-b2bb-22bde6835f41 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.435664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16140c3-7a40-4baa-a2ff-e32755e5b5e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.440824 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.441236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.441585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.441837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.441928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.442110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.442332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.442426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.443029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.443121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.444590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.444705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.456753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 977/1935] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:08.456952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 959/1936] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:08.460501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.461720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.478241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a65-0d25-4d08-8048-6ef12a78a829 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.481558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b60865-c170-4411-9856-c3b0fd4bdfbd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.489517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.490198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.490509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.490802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] PATH_INFO: `/v3/projects/7e9a584da9b44185a41a81c821d29ec2/users/e37932d0843d4ea19e1b7e1176434c2f/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.494741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.495438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.495721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.495997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] PATH_INFO: `/v3/projects/8f42f6e4ee444cb9913170224a527d0f/users/62a3585b79814776b1370dd9b550bd52/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.532843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9a584da9b44185a41a81c821d29ec2, user_id=e37932d0843d4ea19e1b7e1176434c2f, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.533446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f42f6e4ee444cb9913170224a527d0f, user_id=62a3585b79814776b1370dd9b550bd52, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.538023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dfc60-fff9-42a8-8b2d-6b4b6e8a1d85 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.540771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96c034-5200-41bd-8c54-abe24f11b2c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.566664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 960/1937] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:08 2022] PUT /identity/v3/projects/8f42f6e4ee444cb9913170224a527d0f/users/62a3585b79814776b1370dd9b550bd52/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:08.570328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 978/1938] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:08 2022] PUT /identity/v3/projects/7e9a584da9b44185a41a81c821d29ec2/users/e37932d0843d4ea19e1b7e1176434c2f/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:08.578830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.579115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.579390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.583320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.583851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.584512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.621304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] MFA Rules not processed for user `62a3585b79814776b1370dd9b550bd52`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:08.622865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:08.630653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] MFA Rules not processed for user `e37932d0843d4ea19e1b7e1176434c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:08.631785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:08.658729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:08.721491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 961/1939] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:08.726407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.838178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 979/1940] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:08.847328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.909867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0e1d-3997-417f-bc16-9eac01bd7584 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:08.918187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:08.918853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:08.919134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:08.919675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:08.920304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:08.922379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:08.969882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 962/1941] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:08.974515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:08.993024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461689a-b5c5-48e6-9cd1-778ab4d785c9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.058300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:09.083113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf968a4-14db-4be1-ab8e-61444f2158c2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.086459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.087158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.087509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.087848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.088589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.090663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.093831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.094792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.095008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.095290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.096125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.098303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.127343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 963/1942] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:09.130613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 980/1943] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:08 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:09.131216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.133937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.143393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e6b8a-d4b0-4364-bce1-3b025c7c7798 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.211793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:09.213038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.214025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.214339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.214695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.215430 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.217574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.218343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d9b6-4897-46ad-a4f1-23c085f11e9a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.225457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.225936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.226989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.227270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.228305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.231098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.247235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 981/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:09.248366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.250754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 964/1945] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:09 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:09.254822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.266023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67cf-88e3-417c-b979-e6195f3cffd3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.268036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805247-904c-4a92-a1e3-4d47844371cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.272489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.274376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.275350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.276401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] PATH_INFO: `/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6/users/2dfe93349387421daebbd5d5e2b8163f/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.276569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.277470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.277969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.278355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.279294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.281488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.295719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11d36d3c52c4d928d0f11102b6b9bf6, user_id=2dfe93349387421daebbd5d5e2b8163f, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.296315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 965/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:09.300036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.301287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.310589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156235b-bba5-4896-ab15-30e014784ea0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.318211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 982/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:09 2022] PUT /identity/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6/users/2dfe93349387421daebbd5d5e2b8163f/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:09.322036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.376335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.377005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.377285 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.377563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] PATH_INFO: `/v3/projects/91941787e6a645da9594c20ee2085644/users/42107a8699f94294ae33d29bd965d0da/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.396207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91941787e6a645da9594c20ee2085644, user_id=42107a8699f94294ae33d29bd965d0da, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.397732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee80b8-0c4d-4a2b-9415-52440844df36 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.400111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.403038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.403650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.403944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.404199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.404886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.406880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.419463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 966/1948] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:09 2022] PUT /identity/v3/projects/91941787e6a645da9594c20ee2085644/users/42107a8699f94294ae33d29bd965d0da/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:09.420001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 983/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:09.424311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.424462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.438353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560719-77ce-4868-9bc5-2ac681a1141e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.459303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:09.491969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013443-745a-4282-9045-0496cf8d7e89 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.502259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.502965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.503274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.503426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.503516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.503941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.504126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.504305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.504536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] PATH_INFO: `/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6/users/2dfe93349387421daebbd5d5e2b8163f/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.506309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.506571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11d36d3c52c4d928d0f11102b6b9bf6, user_id=2dfe93349387421daebbd5d5e2b8163f, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.509177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31d27-06d8-42a2-8ef5-641afee0506b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.518205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 967/1950] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:09.521073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 984/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:09 2022] PUT /identity/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6/users/2dfe93349387421daebbd5d5e2b8163f/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:09.529737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.531900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.532205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.532474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.544320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2537-b970-43b8-ae76-7c071259c3d9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.566916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] MFA Rules not processed for user `2dfe93349387421daebbd5d5e2b8163f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:09.568362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:09.613989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.615274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.615417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.615788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] PATH_INFO: `/v3/projects/91941787e6a645da9594c20ee2085644/users/42107a8699f94294ae33d29bd965d0da/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.618107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91941787e6a645da9594c20ee2085644, user_id=42107a8699f94294ae33d29bd965d0da, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.620392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:09.620879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f7ddd-67a1-42ad-a106-3e39ab858af7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.635018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 968/1952] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:09 2022] PUT /identity/v3/projects/91941787e6a645da9594c20ee2085644/users/42107a8699f94294ae33d29bd965d0da/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:09.649399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.649574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.649801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.650397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 985/1953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:09.660302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.693792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] MFA Rules not processed for user `42107a8699f94294ae33d29bd965d0da`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:09.695904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:09.747900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa64cba-a485-450f-b47b-d6cd353a8433 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.812180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.814112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.815124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.815746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.818629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 969/1954] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:09.883356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:09.885521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:09.913808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.916704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.918799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80023567-4b9f-4e84-a08a-8f025c95c52a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:09.930451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:09.931681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:09.932137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:09.932409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:09.933085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 986/1955] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:09.944077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:09.945531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:09.957197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 970/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:10.067688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:10.139166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:10.169655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0d51-7493-4162-9f0f-e03e92a9ec6f service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:10.178924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:10.179828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.180102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.180368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] PATH_INFO: `/v3/users/62a3585b79814776b1370dd9b550bd52` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.183331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a3585b79814776b1370dd9b550bd52)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:10.185532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:10.226186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:10.243597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5731065-b8d6-4cf8-883a-50ac536feee6 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:10.256200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:10.256880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.257170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.257525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.262423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:10.302678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a3585b79814776b1370dd9b550bd52'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.312812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:10.313773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a3585b79814776b1370dd9b550bd52'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.329072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a3585b79814776b1370dd9b550bd52'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.329798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a3585b79814776b1370dd9b550bd52'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.330520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c1b34ce0-dd7f-41cb-99dd-c8dea26e9eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a3585b79814776b1370dd9b550bd52'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.374981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 987/1957] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:10 2022] DELETE /identity/v3/users/62a3585b79814776b1370dd9b550bd52 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:10.395652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.395961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.396275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.405476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:10.407275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:10.424989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 971/1958] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:10.464153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:10.465534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:10.568754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 988/1959] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:10.581734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:10.583516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:10.663623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831ab3a-ff0d-4c0f-b2df-6ff0808afc56 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:10.668571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:10.669967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:10.688409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee81895-2a5a-4a6b-9ef3-811ec4753382 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:10.693869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:10.694679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.694951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.695221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] PATH_INFO: `/v3/users/e37932d0843d4ea19e1b7e1176434c2f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.696941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37932d0843d4ea19e1b7e1176434c2f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:10.707557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:10.765167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:10.766840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.767144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.767450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.783859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37932d0843d4ea19e1b7e1176434c2f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.786943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:10.800162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc53f47-55f2-4c17-b805-be3f72d6f6c9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:10.802984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37932d0843d4ea19e1b7e1176434c2f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.815558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 972/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:10.841963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:10.869537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37932d0843d4ea19e1b7e1176434c2f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.872179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37932d0843d4ea19e1b7e1176434c2f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.872896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37932d0843d4ea19e1b7e1176434c2f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:10.901054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 989/1961] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:10 2022] DELETE /identity/v3/users/e37932d0843d4ea19e1b7e1176434c2f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:10.906387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:10.906650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:10.908824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:10.968693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:10.995681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:11.128748 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 973/1962] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:11.140802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:11.144896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:11.246514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4166e1-00e3-4c64-9990-80b24ada5791 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:11.255337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:11.256362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:11.256803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:11.257148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:11.270960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:11.272768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:11.288295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 990/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:11.836891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:11.840998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:11.861750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123958b5-baee-413f-9abb-12d12b26b3f2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:11.867819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:11.868540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:11.868761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:11.869336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] PATH_INFO: `/v3/projects/8f42f6e4ee444cb9913170224a527d0f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:11.871245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f42f6e4ee444cb9913170224a527d0f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:11.873470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:11.904305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:11.941641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f42f6e4ee444cb9913170224a527d0f', 'request_id': 'req-3f5634b3-ad45-45d6-bf70-355bc33b110f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:11.953197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f42f6e4ee444cb9913170224a527d0f', 'request_id': 'req-3f5634b3-ad45-45d6-bf70-355bc33b110f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:11.961090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f42f6e4ee444cb9913170224a527d0f', 'request_id': 'req-3f5634b3-ad45-45d6-bf70-355bc33b110f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:11.975905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] The token cache is being invalidate because project 8f42f6e4ee444cb9913170224a527d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:11.976413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:11.977205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:11.979670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 974/1964] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:11 2022] DELETE /identity/v3/projects/8f42f6e4ee444cb9913170224a527d0f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:11.984096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:12.001244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174417-69b0-4444-89c8-d77927295b1d service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:12.067509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:12.067867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:12.068141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:12.068787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] PATH_INFO: `/v3/users/2dfe93349387421daebbd5d5e2b8163f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:12.069738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfe93349387421daebbd5d5e2b8163f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:12.071853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:12.160563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfe93349387421daebbd5d5e2b8163f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.173460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfe93349387421daebbd5d5e2b8163f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.194117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfe93349387421daebbd5d5e2b8163f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.195289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfe93349387421daebbd5d5e2b8163f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.197556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfe93349387421daebbd5d5e2b8163f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.235970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 991/1965] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:11 2022] DELETE /identity/v3/users/2dfe93349387421daebbd5d5e2b8163f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:12.313931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:12.315540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:12.329842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5634b3-ad45-45d6-bf70-355bc33b110f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:12.443134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:12.444531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:12.444997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:12.445448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] PATH_INFO: `/v3/projects/7e9a584da9b44185a41a81c821d29ec2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:12.447959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9a584da9b44185a41a81c821d29ec2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:12.452290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:12.521225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9a584da9b44185a41a81c821d29ec2', 'request_id': 'req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.535771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9a584da9b44185a41a81c821d29ec2', 'request_id': 'req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.546478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9a584da9b44185a41a81c821d29ec2', 'request_id': 'req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.562306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] The token cache is being invalidate because project 7e9a584da9b44185a41a81c821d29ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:12.562616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.563619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.565818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 975/1966] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:12 2022] DELETE /identity/v3/projects/7e9a584da9b44185a41a81c821d29ec2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:12.569973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:12.573340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:12.584132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:12.594746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb8a83-e151-46b9-a402-a882287b21f5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:12.707652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:12.708745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:12.709134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:12.709475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] PATH_INFO: `/v3/users/42107a8699f94294ae33d29bd965d0da` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:12.711303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42107a8699f94294ae33d29bd965d0da)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:12.713381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:12.778577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:12.780251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:12.808821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d1e9-0d11-441b-83bc-76f91b4dd6c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:12.815309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:12.816152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:12.816529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:12.816958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] PATH_INFO: `/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:12.818449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11d36d3c52c4d928d0f11102b6b9bf6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:12.820735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:12.822985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42107a8699f94294ae33d29bd965d0da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.835055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42107a8699f94294ae33d29bd965d0da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.853734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42107a8699f94294ae33d29bd965d0da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.854919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42107a8699f94294ae33d29bd965d0da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.855895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f86586da-fda3-4c9c-bfed-f712763efa0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42107a8699f94294ae33d29bd965d0da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.868114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:12.877259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 992/1967] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:12 2022] DELETE /identity/v3/users/42107a8699f94294ae33d29bd965d0da => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:12.885830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11d36d3c52c4d928d0f11102b6b9bf6', 'request_id': 'req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.911847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11d36d3c52c4d928d0f11102b6b9bf6', 'request_id': 'req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.927887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11d36d3c52c4d928d0f11102b6b9bf6', 'request_id': 'req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.942569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] The token cache is being invalidate because project a11d36d3c52c4d928d0f11102b6b9bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:12.942934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.943797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b1ce820-3d03-4045-82f4-5fe2d4abbad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:12.949797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 976/1968] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:12 2022] DELETE /identity/v3/projects/a11d36d3c52c4d928d0f11102b6b9bf6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:12.952390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:12.952689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:12.953026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.015075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:13.016296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.117906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 993/1969] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:13.127139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.127449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.127738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.158502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:13.158502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.167818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 977/1970] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:13.172344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.183276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823d913-1d64-411b-ac73-bbf8fe566e5f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.189293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.189972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.190255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.190556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.191254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:13.191573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.193366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.210870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 994/1971] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:13.211602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.211786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.213496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.226078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36e969-fd42-4881-9335-a77b11968c5a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.227388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39b78-ade6-46c3-957a-f78cc02d0ad3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.232210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.233473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.233751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.234116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] PATH_INFO: `/v3/projects/91941787e6a645da9594c20ee2085644` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.235432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91941787e6a645da9594c20ee2085644)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.237026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.237446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.237654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.237947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.238385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.239058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.240432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:13.242236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.301019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 978/1972] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:13.305167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.334928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91941787e6a645da9594c20ee2085644', 'request_id': 'req-d95c28de-9483-4058-9257-5ede601d7bc7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:13.345814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91941787e6a645da9594c20ee2085644', 'request_id': 'req-d95c28de-9483-4058-9257-5ede601d7bc7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:13.357473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91941787e6a645da9594c20ee2085644', 'request_id': 'req-d95c28de-9483-4058-9257-5ede601d7bc7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:13.375136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] The token cache is being invalidate because project 91941787e6a645da9594c20ee2085644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:13.375465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:13.376100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d95c28de-9483-4058-9257-5ede601d7bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:13.378303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 995/1973] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:13 2022] DELETE /identity/v3/projects/91941787e6a645da9594c20ee2085644 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:13.384188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6f48-bf1c-4195-946b-3f8ec32a25f0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.384565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6f48-bf1c-4195-946b-3f8ec32a25f0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.384938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6f48-bf1c-4195-946b-3f8ec32a25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.414291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a96b6f48-bf1c-4195-946b-3f8ec32a25f0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:13.415762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a96b6f48-bf1c-4195-946b-3f8ec32a25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.442018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c456-86e8-43c6-ae6c-59748366a876 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.550353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 996/1974] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:13.556829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.557086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.557323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.588313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.588313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.588313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.588933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.589660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.589986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:13.591319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.593132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.606320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 997/1975] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:13.610514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.628126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce04f3f-9e21-402a-9a27-4ebee117c6c2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.641312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.641939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.642215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.642698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.643365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:13.643707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.648146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.655507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 979/1976] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/users => generated 286 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:13.659120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.660987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:13.673279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 998/1977] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:08:13.674378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d977e-e477-49ca-8ae5-f466c3b7a27c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.677796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.681173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.682955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.683243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.683521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.684518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.687448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.691267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb79da-b65d-41dd-abb1-16afbd1252aa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.697083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.697751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.698019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.699993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.704227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.706335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.709289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 980/1978] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:13.710295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.723944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4331eb-b787-41e7-930e-24551a435052 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.730628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.731363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.731916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.740254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.741243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.744149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.750311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 999/1979] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:13.757720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.765518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 981/1980] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:13.766540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.780814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cbafb-f15b-4ce1-94f9-f1a05f327454 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.788458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:13.844912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:13.867225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca21ea-52c6-4911-aea3-a8416dc35f14 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.880667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.882560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.884647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.885948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.886780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.890542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.906508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.907417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.907795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.908198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] PATH_INFO: `/v3/projects/735bcf99831748e3b32f0abc6e80db8f/users/caad97a980cb4dd59b123f7537aac9b6/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.949253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1000/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:13.949253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:13.951186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735bcf99831748e3b32f0abc6e80db8f, user_id=caad97a980cb4dd59b123f7537aac9b6, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.955385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf69bb-bc8c-44fe-a419-793186c18a19 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.958587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e778a-185e-4300-a0a7-813204678fd3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:13.965598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:13.966421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:13.967304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:13.967304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:13.967576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:13.975733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:13.981207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 982/1982] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:13 2022] PUT /identity/v3/projects/735bcf99831748e3b32f0abc6e80db8f/users/caad97a980cb4dd59b123f7537aac9b6/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:14.000124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.000543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.001311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.010492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1001/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:14.014979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.028232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489241-a8bc-4b45-8927-0c29e01df6fc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.068297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] MFA Rules not processed for user `caad97a980cb4dd59b123f7537aac9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:14.069564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.159486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.160207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.160629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.160939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.175582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.184052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.218495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1002/1984] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:14.222502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.236702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d86b-8424-4885-92a7-30008b945e6c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.246667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.249176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.251335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.251728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] PATH_INFO: `/v3/projects/7b35ffe23c8b4e03b0b8234abbc4fee7/users/9b6951d58d1249adb3c3f10556b9e905/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.282927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 983/1985] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:14.294226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.296428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.309452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b35ffe23c8b4e03b0b8234abbc4fee7, user_id=9b6951d58d1249adb3c3f10556b9e905, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.314495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb6ee5-7c0b-4055-b6fa-2e9977e35f4a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.351316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1003/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:14 2022] PUT /identity/v3/projects/7b35ffe23c8b4e03b0b8234abbc4fee7/users/9b6951d58d1249adb3c3f10556b9e905/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:14.365458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.366195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.366195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.401514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b41277-b15f-4b7a-99a7-b5d8cc50d34f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.434741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] MFA Rules not processed for user `9b6951d58d1249adb3c3f10556b9e905`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:14.436720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.463560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:14.493008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.493762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.494045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.494345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.561609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1004/1987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:14.576148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.579398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.588744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.590310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.605322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 984/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:14.624471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:14.628814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.690899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb98b7-8120-4b4c-8819-db0055347ae6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.697548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.698168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.698495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.698767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.714166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.715832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.727427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1005/1989] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:14.735447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad906cf-c7ff-406d-ba28-5082d23f934c service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.740547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.741301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.741588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.741862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] PATH_INFO: `/v3/users/caad97a980cb4dd59b123f7537aac9b6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.743117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=caad97a980cb4dd59b123f7537aac9b6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.745036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.819499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caad97a980cb4dd59b123f7537aac9b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.826296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caad97a980cb4dd59b123f7537aac9b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.827639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:14.829751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.843574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caad97a980cb4dd59b123f7537aac9b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.849122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de4e6b-fa5b-484d-a219-acab368d3eab service glance] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:14.855593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:14.856541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.856866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.857257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] PATH_INFO: `/v3/users/e187bd6e25eb4bf29bbe52deaa6ae9d9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.859651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e187bd6e25eb4bf29bbe52deaa6ae9d9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:14.863713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:14.878453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caad97a980cb4dd59b123f7537aac9b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.881372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-394f6a9c-99d6-4c58-802a-cb96d6632d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caad97a980cb4dd59b123f7537aac9b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.911761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 985/1990] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:14 2022] DELETE /identity/v3/users/caad97a980cb4dd59b123f7537aac9b6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:14.919862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:14.920741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:14.921160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:14.939828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e187bd6e25eb4bf29bbe52deaa6ae9d9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.969814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:14.973908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:14.976788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e187bd6e25eb4bf29bbe52deaa6ae9d9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:14.997673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:15.005945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e187bd6e25eb4bf29bbe52deaa6ae9d9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:15.008491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e187bd6e25eb4bf29bbe52deaa6ae9d9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:15.009668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3dee0e7c-9fa8-463b-a84e-deee55f74d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e187bd6e25eb4bf29bbe52deaa6ae9d9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:15.040808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1006/1991] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:14 2022] DELETE /identity/v3/users/e187bd6e25eb4bf29bbe52deaa6ae9d9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:15.043112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:15.043507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:15.044229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:15.077820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:15.079154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:15.102168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 986/1992] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:15.108967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:15.111997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:15.176898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1007/1993] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:15.190481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:15.197977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:15.271744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:15.293321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695359a4-48a5-4844-9def-39b2599cc5e2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:15.329669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70201de-2af4-46ff-8420-51eb53d7242e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:15.334813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:15.334944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:15.335247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:15.335742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:15.345676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:15.347781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:15.361085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1008/1994] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:15.451061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:15.451737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:15.452015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:15.452320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:15.475276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:15.479239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:15.505987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 987/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:16.085966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.087958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.107401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e82f-c1ed-491e-9e4b-e9db96802859 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.131084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.131978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.132071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.133198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] PATH_INFO: `/v3/projects/9306300b22454734b3f81606bd474be7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.135736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9306300b22454734b3f81606bd474be7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.137752 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.182701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.183996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.205654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bbf2a-e8fb-4236-8bf1-5a46c2564c0f service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.226052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9306300b22454734b3f81606bd474be7', 'request_id': 'req-02611124-2da5-45ba-b982-d815e544bb84'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.242940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9306300b22454734b3f81606bd474be7', 'request_id': 'req-02611124-2da5-45ba-b982-d815e544bb84'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.251964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9306300b22454734b3f81606bd474be7', 'request_id': 'req-02611124-2da5-45ba-b982-d815e544bb84'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.267216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] The token cache is being invalidate because project 9306300b22454734b3f81606bd474be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:16.267885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.268877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.270708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1009/1996] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:16 2022] DELETE /identity/v3/projects/9306300b22454734b3f81606bd474be7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:16.275148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.276719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.291055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.291711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.291991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.292264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] PATH_INFO: `/v3/projects/735bcf99831748e3b32f0abc6e80db8f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.293784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735bcf99831748e3b32f0abc6e80db8f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.295776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.307948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:16.358877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611124-2da5-45ba-b982-d815e544bb84 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.364803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735bcf99831748e3b32f0abc6e80db8f', 'request_id': 'req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.374653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735bcf99831748e3b32f0abc6e80db8f', 'request_id': 'req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.386728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735bcf99831748e3b32f0abc6e80db8f', 'request_id': 'req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.401621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] The token cache is being invalidate because project 735bcf99831748e3b32f0abc6e80db8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:16.401621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.402204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2c305ab-8d10-4a2a-94b2-ad9b61cd44e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.410155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 988/1997] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:16 2022] DELETE /identity/v3/projects/735bcf99831748e3b32f0abc6e80db8f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:16.410377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf6f9-fd09-4d62-ba66-9780b18f708f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.410501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf6f9-fd09-4d62-ba66-9780b18f708f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.410775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf6f9-fd09-4d62-ba66-9780b18f708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.434562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d9cf6f9-fd09-4d62-ba66-9780b18f708f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:16.435853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d9cf6f9-fd09-4d62-ba66-9780b18f708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.447127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.448046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.448471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.448762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] PATH_INFO: `/v3/users/f271f8f2873c41be9ad2eace3eba513c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.452129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f271f8f2873c41be9ad2eace3eba513c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.454474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.457437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:16.522791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f271f8f2873c41be9ad2eace3eba513c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.526767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 989/1998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:16.534904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.535499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.535869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.542577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f271f8f2873c41be9ad2eace3eba513c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.562374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:16.566689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.585094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 990/1999] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:16.589112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.591877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f271f8f2873c41be9ad2eace3eba513c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.593388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f271f8f2873c41be9ad2eace3eba513c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.594378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f271f8f2873c41be9ad2eace3eba513c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:16.599600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8a43-9152-459f-9c0b-ac979eeec784 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.617381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.618333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.618611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.618919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.620341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:16.620341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.624500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.626723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1010/2000] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:16 2022] DELETE /identity/v3/users/f271f8f2873c41be9ad2eace3eba513c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:16.642152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 991/2001] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:16.650090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.653896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:16.769460 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6da22-c059-407f-90d9-c01aba9337fb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.776393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.777072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.777354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.777625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.778520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.780524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.825749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1011/2002] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:16 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:16.831694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:16.842943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054f17-711b-4b5c-9301-d92eed405d00 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:16.941011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:16.941753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:16.942155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:16.943214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:16.943974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:16.949391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:16.996471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 992/2003] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:16 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:17.001501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.026023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4489-66a5-4d7e-821b-46672f91f62d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.045102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.046600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.046887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.047160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.048040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.057731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.080977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1012/2004] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:17.085227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.087659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.090337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:17.104614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630f16-6fd4-47ef-926e-ad0bcfaaf56f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.112057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.113622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.113622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.113817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e49e1-4a15-412b-b1d8-74b993c0d856 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.113899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.114554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.116497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.124575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:17.135533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.137922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.137922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.137922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] PATH_INFO: `/v3/projects/4781673a4ac14575a54a77abdf7b640a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.139004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4781673a4ac14575a54a77abdf7b640a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.141267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.149282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 993/2005] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:17.151094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.165462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca8ae-22c9-4cf6-8d0a-9b96c5ef423d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.172858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.173870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.174533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.174893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] PATH_INFO: `/v3/projects/4858441b2436456a8e5172b40b5738e4/users/b54e8fa8416f4d319aa2c7e6370c92ac/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.207764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4858441b2436456a8e5172b40b5738e4, user_id=b54e8fa8416f4d319aa2c7e6370c92ac, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.213141 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7669-41a0-4bc7-907d-85c245697ae2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.236911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:17.240160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4781673a4ac14575a54a77abdf7b640a', 'request_id': 'req-8c72cc1b-738b-4d39-a28e-9570c091b9b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:17.254590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 994/2006] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:17 2022] PUT /identity/v3/projects/4858441b2436456a8e5172b40b5738e4/users/b54e8fa8416f4d319aa2c7e6370c92ac/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:17.260207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4781673a4ac14575a54a77abdf7b640a', 'request_id': 'req-8c72cc1b-738b-4d39-a28e-9570c091b9b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:17.261023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.261547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.261924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.272420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4781673a4ac14575a54a77abdf7b640a', 'request_id': 'req-8c72cc1b-738b-4d39-a28e-9570c091b9b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:17.294862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] The token cache is being invalidate because project 4781673a4ac14575a54a77abdf7b640a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:17.294973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:17.299467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8c72cc1b-738b-4d39-a28e-9570c091b9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:17.302919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1013/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:17 2022] DELETE /identity/v3/projects/4781673a4ac14575a54a77abdf7b640a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:17.307913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a1c-d025-468e-b3ee-0b605245e366 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.308299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a1c-d025-468e-b3ee-0b605245e366 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.308788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a1c-d025-468e-b3ee-0b605245e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.312903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:17.314558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:17.357325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-972a7a1c-d025-468e-b3ee-0b605245e366 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:17.360757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-972a7a1c-d025-468e-b3ee-0b605245e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:17.407736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 995/2008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:17.421847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.423607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:17.436794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1014/2009] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:17.445459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119830-33c9-4256-9206-e21eebf6201b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.445959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119830-33c9-4256-9206-e21eebf6201b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.446255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119830-33c9-4256-9206-e21eebf6201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.478766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-98119830-33c9-4256-9206-e21eebf6201b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:17.480135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-98119830-33c9-4256-9206-e21eebf6201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:17.493165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1015/2010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:17.494469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98119830-33c9-4256-9206-e21eebf6201b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.506050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98119830-33c9-4256-9206-e21eebf6201b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.511283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.511787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.512166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.513121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.514183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:17.514183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.524245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.551241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1016/2011] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:17.555473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.570157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254557-392d-49e1-86a0-0ecca87cfad1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.572175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106617df-c2fe-4967-aec9-c0b9121bca5e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.579309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.580006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.580286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.580558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.583116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.583708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.583980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.584245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.584903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.586791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.601761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.605215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.627128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1017/2012] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:17.630949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.634722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 996/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:17.729682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7683b95-3b4d-4d0b-a9ff-d793f504ecb7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.737896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.738806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.739089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.739362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.740014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.745548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.782560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1018/2014] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:17.784129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.794889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae7a46-1739-48a5-8fba-3378bdc6bd6b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.801647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.802581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.803170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.803739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.804926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.807267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.822399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 997/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:17.826067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.841429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5b78-bcb6-43f7-a12c-b3af2a142173 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.846685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.847301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.847576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.847848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.848497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.850183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7825d9c-6e49-4c89-b2f2-af35f5ca10a0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.861582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1019/2016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:17.865705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:17.880193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac8b0-2fc0-453a-916a-fe8a2655ae38 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:17.885803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:17.887050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.887247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.893584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] PATH_INFO: `/v3/projects/19da6f77b0fd473c932a03a98fcf4be8/users/4378ef02774e4e69b71dd018b3039614/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:17.907053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19da6f77b0fd473c932a03a98fcf4be8, user_id=4378ef02774e4e69b71dd018b3039614, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:17.910379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:17.931886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 998/2017] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:17 2022] PUT /identity/v3/projects/19da6f77b0fd473c932a03a98fcf4be8/users/4378ef02774e4e69b71dd018b3039614/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:17.944052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:17.944820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:17.944820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:18.002584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:18.008270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] MFA Rules not processed for user `4378ef02774e4e69b71dd018b3039614`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:18.011360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:18.151340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1020/2018] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:18.163252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:18.171539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:18.321085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:18.343350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb21-b5aa-49c8-94a7-279fcae4a86c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:18.353366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:18.354011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:18.356386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:18.356741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:18.380175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:18.381598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f6d5-0936-4b2b-b2f2-28d850b38dc8 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:18.398181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 999/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:18.440202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:18.601931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e5085-3f11-42d1-ae4b-0ca5fe943abd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:18.621145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:18.622957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:18.622957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:18.622957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] PATH_INFO: `/v3/users/4378ef02774e4e69b71dd018b3039614` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:18.624194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4378ef02774e4e69b71dd018b3039614)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:18.626732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:18.709110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4378ef02774e4e69b71dd018b3039614'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:18.718441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4378ef02774e4e69b71dd018b3039614'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:18.735518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4378ef02774e4e69b71dd018b3039614'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:18.736326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4378ef02774e4e69b71dd018b3039614'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:18.737072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-272d8b0d-59d0-4702-b8c9-2db3779b28e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4378ef02774e4e69b71dd018b3039614'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:18.766915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1021/2020] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:18 2022] DELETE /identity/v3/users/4378ef02774e4e69b71dd018b3039614 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:18.771619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:18.771909 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:18.772507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:18.805838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:18.807463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:18.829544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:18.829961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:18.830445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:18.877631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] MFA Rules not processed for user `b54e8fa8416f4d319aa2c7e6370c92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:18.879116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:18.892671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:18.903527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1000/2021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:18.916765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:18.918804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:18.971803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1022/2022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:18.984964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:18.987424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:19.007483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070723a-a37a-4eb9-821b-17e8a02a4d8d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.012217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.012951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.013411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.013739 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.030013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.032435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.058568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1001/2023] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:19.084353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e7a5-57e3-4685-a94d-a13529ebad55 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.088376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.088995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.089270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.089537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.098803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.100492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d967ee9-9926-4639-802c-a6047377b78e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.116943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1023/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:19.349258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:19.353138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:19.372322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d818-92c0-4bdb-a138-fda1f52e9de8 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.388566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.389245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.389759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.390500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] PATH_INFO: `/v3/projects/19da6f77b0fd473c932a03a98fcf4be8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.392300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19da6f77b0fd473c932a03a98fcf4be8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.403079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.469859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19da6f77b0fd473c932a03a98fcf4be8', 'request_id': 'req-a93a895b-8db0-46c1-8c7a-4de2a0554099'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:19.481510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19da6f77b0fd473c932a03a98fcf4be8', 'request_id': 'req-a93a895b-8db0-46c1-8c7a-4de2a0554099'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:19.489349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19da6f77b0fd473c932a03a98fcf4be8', 'request_id': 'req-a93a895b-8db0-46c1-8c7a-4de2a0554099'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:19.515067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] The token cache is being invalidate because project 19da6f77b0fd473c932a03a98fcf4be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:19.515378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:19.516484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a93a895b-8db0-46c1-8c7a-4de2a0554099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:19.518119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1002/2025] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:19 2022] DELETE /identity/v3/projects/19da6f77b0fd473c932a03a98fcf4be8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:19.523600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.524553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.525111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.557020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:19.558353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:19.647104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1024/2026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:19.648920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.649374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.649805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.687991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:19.690496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:19.703558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1003/2027] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:19.708687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:19.721994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf7d4-f640-438d-b4f2-a8520f681bb8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.727617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.728421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.728778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.729160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.729976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:19.730405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.732318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.747858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1025/2028] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:19.752184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:19.768563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e70d-2bd7-4d26-81d8-e6255a59067e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.783794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.784498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.784770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.785045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.785817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.789926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.795869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:19.835979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:19.842563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1004/2029] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:19 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:19.848274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d246-75f4-498d-bec6-97a1dc476005 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.913039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:19.931695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.932332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.932613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.932885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.933658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.935501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.958023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1026/2030] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:19 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:19.962108 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:19.973148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6382ea-dfaf-411e-9bf7-c3befde59c36 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:19.977917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:19.978846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:19.979529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:19.979813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:19.980519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:19.982111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:19.993211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1005/2031] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:19.997738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:20.009102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07f2d-a01b-48b0-a063-ca0e56df64f4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:20.017272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:20.017896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.018178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.018490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.019194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:20.020777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20f81-e2cf-4231-8229-d76debd0143d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:20.032864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1027/2032] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:20.037345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:20.047943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d4b-dadb-4ffb-902f-236329805fe6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:20.052806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:20.053455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.053735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.054008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] PATH_INFO: `/v3/projects/46cbc2734e7b4b89973da08bd7270cc7/users/7c4bb1dcd5714ae5a9594291640a782d/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.068715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cbc2734e7b4b89973da08bd7270cc7, user_id=7c4bb1dcd5714ae5a9594291640a782d, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:20.071459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:20.085001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1006/2033] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:20 2022] PUT /identity/v3/projects/46cbc2734e7b4b89973da08bd7270cc7/users/7c4bb1dcd5714ae5a9594291640a782d/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:20.095830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.096221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.096565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.125516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] MFA Rules not processed for user `7c4bb1dcd5714ae5a9594291640a782d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:20.126890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:20.191305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1028/2034] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:20.225645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:20.227442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:20.285504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b9afb-ad66-473b-94f6-d1d6b736a6e2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:20.289199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:20.289802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.290081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.290387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.298582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:20.300000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d31799-69d2-474e-b720-fdf8ada73fd0 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:20.309030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1007/2035] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:20.324613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:20.388127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad536f4-13a5-4d27-9857-254c287f99ed None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:20.393321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:20.393943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.394217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.394518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] PATH_INFO: `/v3/users/7c4bb1dcd5714ae5a9594291640a782d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.395626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4bb1dcd5714ae5a9594291640a782d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:20.397546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:20.443264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4bb1dcd5714ae5a9594291640a782d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:20.447767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:20.452170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4bb1dcd5714ae5a9594291640a782d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:20.464665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4bb1dcd5714ae5a9594291640a782d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:20.465324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4bb1dcd5714ae5a9594291640a782d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:20.465931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0451a4ff-9d79-4127-844e-0b93448b8969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4bb1dcd5714ae5a9594291640a782d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:20.479050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1029/2036] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:20 2022] DELETE /identity/v3/users/7c4bb1dcd5714ae5a9594291640a782d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:20.483466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.483928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.484149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.503583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:20.504784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:20.534075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.534651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.534651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.555995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] MFA Rules not processed for user `b54e8fa8416f4d319aa2c7e6370c92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:20.557221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:20.570591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1008/2037] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:20.581168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:20.582556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:20.618541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1030/2038] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:20.642601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3eb46-7d6f-4b69-b761-f624ddbcfcc4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:20.646283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:20.646908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:20.647189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:20.647531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:20.654639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:20.658504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:20.660880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f19a39-3e03-4750-8fcf-a822338af7ba service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:20.672762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1009/2039] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:21.099963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.101382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:21.133046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffbb2-868f-4491-9530-cee876d3a063 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.154023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.155250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.155576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.155773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] PATH_INFO: `/v3/projects/46cbc2734e7b4b89973da08bd7270cc7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.157568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cbc2734e7b4b89973da08bd7270cc7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.159709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.230763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cbc2734e7b4b89973da08bd7270cc7', 'request_id': 'req-67ff9a72-95e5-49ff-96c6-d4707102da83'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:21.243345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cbc2734e7b4b89973da08bd7270cc7', 'request_id': 'req-67ff9a72-95e5-49ff-96c6-d4707102da83'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:21.252121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cbc2734e7b4b89973da08bd7270cc7', 'request_id': 'req-67ff9a72-95e5-49ff-96c6-d4707102da83'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:21.265728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] The token cache is being invalidate because project 46cbc2734e7b4b89973da08bd7270cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:21.266207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:21.269048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67ff9a72-95e5-49ff-96c6-d4707102da83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:21.274311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1031/2040] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:21 2022] DELETE /identity/v3/projects/46cbc2734e7b4b89973da08bd7270cc7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:21.276591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.276881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.277160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.298328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:21.299563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:21.369566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1010/2041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:21.377480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.377847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.378207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.400938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:21.402227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:21.412379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1032/2042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:21.417166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.429487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fb73-e7dd-4504-bef5-561274c770b7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.434292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.434918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.435188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.435472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.436167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:21.436472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.438075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.454300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1011/2043] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:21.458750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.470907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18354ec-0107-4433-a47b-69c06e5d622f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.479655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.480463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.480747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.481206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.482000 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.484132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.514942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1033/2044] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:21.519471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.530424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603795-79ca-43bc-b363-682094e28c8d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.597719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.598375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.598787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.599064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.599872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.608003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.635902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1012/2045] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:21.643538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.655909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7606da7-6148-4a4d-94bf-a1b3d4ad8a6c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.660768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.661374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.661652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.661921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.662595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.664317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.675936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1034/2046] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:21.680456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.691995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f128b-5286-4d53-be02-b19dd5b256ef admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.696666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.697337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.697540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.697911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.698474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.700077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd183485-7bf3-4d2b-bcc6-580986195375 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.711502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1013/2047] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:21.715581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.726293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f5364-f204-4319-8942-19c021fd0c69 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.731252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.731906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.732189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.732494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] PATH_INFO: `/v3/projects/ec73cadb0a364db4812d61d19790e5d4/users/94de73c0d83843db96fcfdd64b8ea7ba/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.749221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec73cadb0a364db4812d61d19790e5d4, user_id=94de73c0d83843db96fcfdd64b8ea7ba, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.752034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:21.754311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:21.774052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1035/2048] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:21 2022] PUT /identity/v3/projects/ec73cadb0a364db4812d61d19790e5d4/users/94de73c0d83843db96fcfdd64b8ea7ba/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:21.786451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.786822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.787109 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.828209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] MFA Rules not processed for user `94de73c0d83843db96fcfdd64b8ea7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:21.829438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:21.884107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:21.904138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1014/2049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:21.909152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:21.984244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601cc13-2dcf-4e3e-a7c5-3eb84fd7f2ef admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:21.991743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:21.992353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:21.992628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:21.992895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:21.993585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:21.995524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.027066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1036/2050] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:21 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:22.031368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.042305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb58d3e-8904-4017-a326-6c588e55f959 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.115052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.115683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.115994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.116288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.117505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.119588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.140813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1015/2051] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:22 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:22.144859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.155666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a1e1-c4d7-4fc9-a681-4627d8e92a73 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.160422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.161158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.161424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.161694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.162382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.163984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.175323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1037/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:22.179732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.190542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb6295-dc96-4e8c-96aa-ec9d037fb372 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.195729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.196549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.196833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.197113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] PATH_INFO: `/v3/projects/ce9393426c0645a9825f3fd20fc13fec/users/1a0a9428aae3414e8413a275cd70077c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.222769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9393426c0645a9825f3fd20fc13fec, user_id=1a0a9428aae3414e8413a275cd70077c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.225633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.239705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1016/2053] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:22 2022] PUT /identity/v3/projects/ce9393426c0645a9825f3fd20fc13fec/users/1a0a9428aae3414e8413a275cd70077c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:22.243777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.255870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efaf19-ce2b-420f-8e79-69e792c8914d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.325173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.325773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.326922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.326996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.327646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.329225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4e50-3b4e-4b77-babc-7fd8bf4216ff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.341673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1038/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:22.345625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.370033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853b61-2985-4706-aa26-7981867aa3da admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.376189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.376901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.377182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.377543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] PATH_INFO: `/v3/projects/ce9393426c0645a9825f3fd20fc13fec/users/1a0a9428aae3414e8413a275cd70077c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.379759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9393426c0645a9825f3fd20fc13fec, user_id=1a0a9428aae3414e8413a275cd70077c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.383495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.396984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1017/2055] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:22 2022] PUT /identity/v3/projects/ce9393426c0645a9825f3fd20fc13fec/users/1a0a9428aae3414e8413a275cd70077c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:22.408719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.409010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.409273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.475690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] MFA Rules not processed for user `1a0a9428aae3414e8413a275cd70077c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:22.477065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:22.584200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:22.618699 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1039/2056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:22.631350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:22.633979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:22.722436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450e9b-1ffb-472c-957a-2c33023bff58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:22.728848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:22.729749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:22.730119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:22.730764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:22.814000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:22.815735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9897b-9b2c-4988-8b31-1bcf4e59fa7f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:22.819326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:22.834720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1018/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:25.146222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:25.149017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:25.251695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c47e9d-3f21-4335-a288-dd195a52fc98 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:25.262363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:25.264263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:25.265179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:25.265912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] PATH_INFO: `/v3/users/89713cefba434585912812fbd9764500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:25.266876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89713cefba434585912812fbd9764500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:25.269148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:25.349255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89713cefba434585912812fbd9764500'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.358797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89713cefba434585912812fbd9764500'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.372725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89713cefba434585912812fbd9764500'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.374106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89713cefba434585912812fbd9764500'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.374743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89713cefba434585912812fbd9764500'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.396595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1040/2058] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:25 2022] DELETE /identity/v3/users/89713cefba434585912812fbd9764500 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:25.401396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:25.401875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:25.402053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:25.422898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:25.424062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:25.504167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1019/2059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:25.521609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:25.522991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:25.594755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b3c49-8fea-45b7-81ed-25d5dcd84934 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:25.599069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:25.599682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:25.599962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:25.600226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:25.611243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:25.612714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9438-1a71-49c1-a9bd-78f3bc966fb8 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:25.629905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1041/2060] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:25.677829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:25.680311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:25.697445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e3ded-655e-49fa-a1ce-62968ac5e5b9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:25.703569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:25.704411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:25.704759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:25.705162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] PATH_INFO: `/v3/users/94de73c0d83843db96fcfdd64b8ea7ba` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:25.711032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94de73c0d83843db96fcfdd64b8ea7ba)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:25.718937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:25.797339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94de73c0d83843db96fcfdd64b8ea7ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.798149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94de73c0d83843db96fcfdd64b8ea7ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.810413 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94de73c0d83843db96fcfdd64b8ea7ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.832227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94de73c0d83843db96fcfdd64b8ea7ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.833357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94de73c0d83843db96fcfdd64b8ea7ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:25.854198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1020/2061] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:25 2022] DELETE /identity/v3/users/94de73c0d83843db96fcfdd64b8ea7ba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:25.859200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:25.859730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:25.860554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:25.922376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:25.923444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:25.929567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:26.031386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:26.032951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:26.049687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53039-2aab-4ee9-bbcb-1c948e98b64c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:26.055696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:26.056571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:26.056812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:26.057092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] PATH_INFO: `/v3/projects/cff1b835171f4550b2f96d45be4afebc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:26.058443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff1b835171f4550b2f96d45be4afebc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:26.060373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:26.064313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1042/2062] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:26.080483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:26.081992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:26.179762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff1b835171f4550b2f96d45be4afebc', 'request_id': 'req-d9d1f53e-d7da-4bbb-a13f-b90a27790776'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.197427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff1b835171f4550b2f96d45be4afebc', 'request_id': 'req-d9d1f53e-d7da-4bbb-a13f-b90a27790776'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.212505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c11e-f8af-4da6-9b12-b561dc469795 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:26.214135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff1b835171f4550b2f96d45be4afebc', 'request_id': 'req-d9d1f53e-d7da-4bbb-a13f-b90a27790776'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.215468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:26.243127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] The token cache is being invalidate because project cff1b835171f4550b2f96d45be4afebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:26.243568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.249203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.252854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1021/2063] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:26 2022] DELETE /identity/v3/projects/cff1b835171f4550b2f96d45be4afebc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:26.259382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:26.261221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:26.308697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:26.309610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:26.310002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:26.310946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:26.313037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:26.396922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1f53e-d7da-4bbb-a13f-b90a27790776 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:26.402025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:26.402713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:26.402998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:26.403277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] PATH_INFO: `/v3/users/e95571f1da8c46fdbcd0e2a0bf392d03` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:26.404672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95571f1da8c46fdbcd0e2a0bf392d03)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:26.407426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:26.478857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:26.480397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefe46b-1374-4144-9c87-146b46087836 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:26.513362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95571f1da8c46fdbcd0e2a0bf392d03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.515071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95571f1da8c46fdbcd0e2a0bf392d03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.522895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95571f1da8c46fdbcd0e2a0bf392d03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.537806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95571f1da8c46fdbcd0e2a0bf392d03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.538741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3999b042-78cf-4226-8e0f-cc5922fb2016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95571f1da8c46fdbcd0e2a0bf392d03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:26.553576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1043/2064] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:26.587034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1022/2065] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:26 2022] DELETE /identity/v3/users/e95571f1da8c46fdbcd0e2a0bf392d03 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:26.922461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:26.922976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:26.923249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:26.924910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1044/2066] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:08:26.976062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8f77-dea6-4a4f-99a0-21328682583e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:26.976062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8f77-dea6-4a4f-99a0-21328682583e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:26.976062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8f77-dea6-4a4f-99a0-21328682583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.006219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-57fe8f77-dea6-4a4f-99a0-21328682583e None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:27.011833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57fe8f77-dea6-4a4f-99a0-21328682583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.131136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1023/2067] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:27.136134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.138530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.151760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf65f4-177a-457a-bd9e-f57c3730da9f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.153461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf65f4-177a-457a-bd9e-f57c3730da9f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.153939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf65f4-177a-457a-bd9e-f57c3730da9f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.164300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1024/2068] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 15:08:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:08:27.170312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.170845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.171357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.177120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:27.203162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:27.205321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.222519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1025/2069] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:27.248450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0c4a-5055-4a2d-be33-be182c40310f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.249175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.255799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:27.268059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bce06-4896-4637-86c9-2d160700c7a2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.269225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.270231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.270749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.271266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] PATH_INFO: `/v3/users/4731961874e54d8a9f79f207572908aa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.273343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4731961874e54d8a9f79f207572908aa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.276290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.276838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.277577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.277963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.279356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.293570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.295749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.343854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1026/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:27.345633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.350666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.366180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4731961874e54d8a9f79f207572908aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.371779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894922-0982-4de5-9193-0332d6c7841b service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.377453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.378098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.378459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.378699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] PATH_INFO: `/v3/projects/ec73cadb0a364db4812d61d19790e5d4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.379528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4731961874e54d8a9f79f207572908aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.379830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec73cadb0a364db4812d61d19790e5d4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.381743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.400776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4731961874e54d8a9f79f207572908aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.401987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4731961874e54d8a9f79f207572908aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.403149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4731961874e54d8a9f79f207572908aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.434648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1045/2071] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:27 2022] DELETE /identity/v3/users/4731961874e54d8a9f79f207572908aa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:27.440875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.443064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.462792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec73cadb0a364db4812d61d19790e5d4', 'request_id': 'req-b86aee52-1add-471a-b8f1-f2625476dff2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.475659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec73cadb0a364db4812d61d19790e5d4', 'request_id': 'req-b86aee52-1add-471a-b8f1-f2625476dff2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.489467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec73cadb0a364db4812d61d19790e5d4', 'request_id': 'req-b86aee52-1add-471a-b8f1-f2625476dff2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.516876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] The token cache is being invalidate because project ec73cadb0a364db4812d61d19790e5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:27.517432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.519084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.521683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1027/2072] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:27 2022] DELETE /identity/v3/projects/ec73cadb0a364db4812d61d19790e5d4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:27.527259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.531004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.580263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a84e2-c075-4202-96f5-35ecf33dd56d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.651242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:27.660394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86aee52-1add-471a-b8f1-f2625476dff2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.671049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.671994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.672540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.673012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] PATH_INFO: `/v3/users/1a0a9428aae3414e8413a275cd70077c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.674666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0a9428aae3414e8413a275cd70077c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.675115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.675769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.676050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.676326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] PATH_INFO: `/v3/projects/917010dcd5734895b32a12f453599d5d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.677608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.684689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=917010dcd5734895b32a12f453599d5d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.686864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.751011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0a9428aae3414e8413a275cd70077c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.751741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0a9428aae3414e8413a275cd70077c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.757501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917010dcd5734895b32a12f453599d5d', 'request_id': 'req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.762439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0a9428aae3414e8413a275cd70077c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.766840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917010dcd5734895b32a12f453599d5d', 'request_id': 'req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.775546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917010dcd5734895b32a12f453599d5d', 'request_id': 'req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.776924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0a9428aae3414e8413a275cd70077c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.777840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5c949b49-357d-4c70-9f3c-2cf18bc46a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0a9428aae3414e8413a275cd70077c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.780071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:27.787822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] The token cache is being invalidate because project 917010dcd5734895b32a12f453599d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:27.787822 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.793757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecd902a9-98fb-48bf-86b9-48a7eebb52cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:27.793757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1046/2073] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:27 2022] DELETE /identity/v3/projects/917010dcd5734895b32a12f453599d5d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:27.798993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.799628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.800227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.806853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1028/2074] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:27 2022] DELETE /identity/v3/users/1a0a9428aae3414e8413a275cd70077c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:27.829811 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:27.831675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.916551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1047/2075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:27.918668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.919057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.919576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.943461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:27.944759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:27.956642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1029/2076] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:27.961325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:27.976196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11517c0b-16bd-4d17-a30e-203dc970fa8d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:27.982462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:27.983172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:27.983346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:27.983615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:27.984301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:27.984841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:27.986237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:27.999290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1048/2077] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:28.005086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.016617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16a4a-1eae-4c97-b86a-a201585309db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.026322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.027802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.028292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.028767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.042057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.047198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.102205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.122645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1030/2078] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:28.124886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.126819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.134758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527998-69f4-4abc-9485-829c0008bb6d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.230337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b039e-adca-4c95-b5b9-c81c10b5163b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.235621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.236317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.236602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.236873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] PATH_INFO: `/v3/projects/96b6113de88048e78409b9b608e38b5a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.238472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b6113de88048e78409b9b608e38b5a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.240438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.266294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.266893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.267184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.267454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.268633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.271805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.287693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:28.310005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1049/2079] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:28.314928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.315635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b6113de88048e78409b9b608e38b5a', 'request_id': 'req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.325695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b6113de88048e78409b9b608e38b5a', 'request_id': 'req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.331285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170d8e-6c7d-4048-a101-c842b39e96e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.345571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b6113de88048e78409b9b608e38b5a', 'request_id': 'req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.358173 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] The token cache is being invalidate because project 96b6113de88048e78409b9b608e38b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:28.358522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.359295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.364391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1031/2080] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:28 2022] DELETE /identity/v3/projects/96b6113de88048e78409b9b608e38b5a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:28.364391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.364391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.426730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.427463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.427750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.428024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.428678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.430561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d67f9-cf3a-45cf-a081-6f88796e2ee5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.450598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1050/2081] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:28.450929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.452586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.452586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.452770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:28.466025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb1be-f5aa-4c77-bab0-7e6ddbdb70bd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.472497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.473131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.473406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.473673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] PATH_INFO: `/v3/projects/ce9393426c0645a9825f3fd20fc13fec` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.474848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9393426c0645a9825f3fd20fc13fec)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.475762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:28.476749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.476967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.486140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1051/2082] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:28.487046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.488425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.499976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457c400-2ec0-45db-8753-ef5856e2bdda None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.504657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.505214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.505492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.505764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.506435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.508651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfdcb9-5985-46db-b448-20237a2f5daa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.519261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1052/2083] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:28.520463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811545-3361-4145-852e-084be64c6306 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.520741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811545-3361-4145-852e-084be64c6306 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.521030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811545-3361-4145-852e-084be64c6306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.526079 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9393426c0645a9825f3fd20fc13fec', 'request_id': 'req-225d2647-96e4-402d-8ac7-4b26c4d49eb1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.534391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9393426c0645a9825f3fd20fc13fec', 'request_id': 'req-225d2647-96e4-402d-8ac7-4b26c4d49eb1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.541638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9393426c0645a9825f3fd20fc13fec', 'request_id': 'req-225d2647-96e4-402d-8ac7-4b26c4d49eb1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.550253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b811545-3361-4145-852e-084be64c6306 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:28.551489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b811545-3361-4145-852e-084be64c6306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.553489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] The token cache is being invalidate because project ce9393426c0645a9825f3fd20fc13fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:28.553801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.554749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:28.557390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1032/2084] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:28 2022] DELETE /identity/v3/projects/ce9393426c0645a9825f3fd20fc13fec => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:28.558500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.562466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.620055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1053/2085] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:28.621341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.621622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.626606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.636330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2647-96e4-402d-8ac7-4b26c4d49eb1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.641004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.642013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.642013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.642218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] PATH_INFO: `/v3/projects/50b16b35dfb24493b883a10d93c8263a/users/bdc653acaa2e41b9b4820f81680c3c69/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.647735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:28.648944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.657169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b16b35dfb24493b883a10d93c8263a, user_id=bdc653acaa2e41b9b4820f81680c3c69, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.657526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1054/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:28.663926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.664092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597531-50b6-4778-ae84-336ec59a6544 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.670501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3b0b-85a7-42df-a823-ba02d69382ed None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.677054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1033/2087] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:28 2022] PUT /identity/v3/projects/50b16b35dfb24493b883a10d93c8263a/users/bdc653acaa2e41b9b4820f81680c3c69/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:28.680375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.681294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.681787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.706949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:28.708165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.746278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.747481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.747890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.748160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.748803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:28.749107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.750737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311187e-b906-4256-817c-f77e93a6a4b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.758511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:28.769339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1055/2088] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:28.769339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.769339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.770525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.774986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1034/2089] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:28.779788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.791412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdace8-ca43-4105-9a94-b2eab8b9f0a3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.796668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.797279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.797555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.797824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.798685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.800570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.805378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] MFA Rules not processed for user `bdc653acaa2e41b9b4820f81680c3c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:28.805662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:28.806741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:28.835548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1035/2090] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:28.836712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.890630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1056/2091] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:28.890630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.900334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09e124-7f2e-4064-a6aa-5c9fcd983ac8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.911740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dd1d-5b08-40d3-b271-ca0d7e7e5cdf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.916587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.917416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.917839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.918116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.919288 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:28.920179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.921811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.938321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1036/2092] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:28.938321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.947434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401380e-52f2-4d0c-af29-c9ecf05b7da6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:28.953030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.953641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.953924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.954231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.955048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.957037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.962785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:28.963464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:28.963873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:28.964211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:28.964904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:28.966953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:28.993491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1037/2093] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/projects => generated 395 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:28.994401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:28.995683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1057/2094] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:29.000234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.010144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7cb0-7892-41ed-acd1-15fd97ebfcfa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.077698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39aa09-133d-4919-abce-a0bdc204922b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.082949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.083637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.083992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.084357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.085007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.085197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.085815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.086151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.086462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.086963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.087090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.088746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.100776 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1058/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:29.101638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.113575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7854649-a6c3-4d78-9033-d78218b35671 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.118517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.119170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.119495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.119718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.120377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.122356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.127472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1038/2096] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:28 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:29.127472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.136553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:29.150625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1059/2097] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:29 2022] POST /identity/v3/users => generated 304 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:29.150625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.167272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe96a2-d411-49b3-935c-2e940e69b185 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.187270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:29.209966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b055817-e87b-4746-a55f-188becc86f5b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.215397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.216015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.216292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.217129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.217932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.219953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.234652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1039/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:29.234652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.245246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb0-57b8-4ab2-a31b-03f654c89c77 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.245661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.246351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.246584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.246848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.247477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.249431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.250333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.250998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.251351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.251686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.252397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.254040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.270428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1040/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:29.270428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.274139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1060/2100] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:29 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:29.275942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.285394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca26f4-c7ea-4efe-be6b-f3e7ed8217c8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.287863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa14fa-cc3a-43d0-9bb7-fcaaae300cbc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.290669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.291438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.291760 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.292122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] PATH_INFO: `/v3/projects/d659665b94294169af30c3d5ecabadbf/users/6bb8f9c24bbf460dab2bfb8ae539b374/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.294171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.295684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.296175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.296475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] PATH_INFO: `/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7/users/11683f1d6efb4b4986ee635128be50ba/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.311827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d659665b94294169af30c3d5ecabadbf, user_id=6bb8f9c24bbf460dab2bfb8ae539b374, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.312663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be25f5a8194a9a9f23cd388f47d3e7, user_id=11683f1d6efb4b4986ee635128be50ba, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.314810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.316014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.329676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1061/2101] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:29 2022] PUT /identity/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7/users/11683f1d6efb4b4986ee635128be50ba/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:29.330022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1041/2102] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:29 2022] PUT /identity/v3/projects/d659665b94294169af30c3d5ecabadbf/users/6bb8f9c24bbf460dab2bfb8ae539b374/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:29.330982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.333833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.392810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0a23-a686-4911-b90a-c2500eb58d17 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.395481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be8c-ffed-4675-8973-9fc713862917 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.397656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.398281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.398590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.398852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.399496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.400184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.400781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.401060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.401148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305d118-ee87-48d8-b827-460b7f6a9d62 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.401331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.401965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.403565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.411622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1062/2103] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:29.412921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.413204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.413477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.413987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1042/2104] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:29.418588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.428813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944213-34b3-4175-b02e-f446ed08cd3c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.432960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:29.433677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.434165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.434308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.434565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.434845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.435521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.437088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.445035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1063/2105] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:29.445035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.448897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1043/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:29.451232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.454407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d79407-2bea-4939-80a6-cccba490a978 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.460401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.460722 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.460912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.461185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] PATH_INFO: `/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7/users/11683f1d6efb4b4986ee635128be50ba/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.461359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93c31-5b04-406e-b9fa-04b341e22302 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.463241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be25f5a8194a9a9f23cd388f47d3e7, user_id=11683f1d6efb4b4986ee635128be50ba, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.465903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.466095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.467267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.467551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.467819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] PATH_INFO: `/v3/projects/24abd195ad714439a19e61409e5689d7/users/4284d0b84f4940c5be4a3ae50fdc3d9b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.481190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1064/2107] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:29 2022] PUT /identity/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7/users/11683f1d6efb4b4986ee635128be50ba/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:29.482068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.484416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.491445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24abd195ad714439a19e61409e5689d7, user_id=4284d0b84f4940c5be4a3ae50fdc3d9b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.495111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d368a0-9fd6-4ac4-abac-53b13420cc1f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.511628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1044/2108] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:29 2022] PUT /identity/v3/projects/24abd195ad714439a19e61409e5689d7/users/4284d0b84f4940c5be4a3ae50fdc3d9b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:29.513527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2410c6-11c6-4169-9e2d-9f6aadb7b413 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.513929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2410c6-11c6-4169-9e2d-9f6aadb7b413 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.514290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2410c6-11c6-4169-9e2d-9f6aadb7b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.542059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:29.558496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6f2410c6-11c6-4169-9e2d-9f6aadb7b413 None None] MFA Rules not processed for user `11683f1d6efb4b4986ee635128be50ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:29.559802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f2410c6-11c6-4169-9e2d-9f6aadb7b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.561956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21693305-d4d8-41cb-8d85-06ba2a8f1d25 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.619034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.619792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.620075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.620525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.634688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:29.673673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1045/2109] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:29.675021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.675310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.675582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.695876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.697399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.704726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] MFA Rules not processed for user `4284d0b84f4940c5be4a3ae50fdc3d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:29.705912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.707986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1065/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:29.708796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.710438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.775145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb8f87-0c45-408a-9620-7f5d75af4d95 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.780172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.780839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1046/2111] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:29.780963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.781208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.781550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.791333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.791475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.792853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.793199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:29.804484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1066/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:29.807186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa99e8-5101-431f-911c-da601a699eb8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.811401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.812231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.812590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.813069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.824568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.826726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:29.838191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1047/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:29.896168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:29.907204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab53-931a-481d-8601-0baad3679e58 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:29.911465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:29.912131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:29.912517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:29.912848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:29.964230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:29.993659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:29.995447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ac20-f760-4903-8fec-d59586ec600c service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:30.007413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1067/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:33.523780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:33.538966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9b1a-7950-4aa3-99f8-0abd11a11433 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:33.551179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:33.552549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:33.555524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:33.555814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] PATH_INFO: `/v3/users/4284d0b84f4940c5be4a3ae50fdc3d9b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:33.557317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4284d0b84f4940c5be4a3ae50fdc3d9b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:33.559538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:33.653612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4284d0b84f4940c5be4a3ae50fdc3d9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:33.655225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4284d0b84f4940c5be4a3ae50fdc3d9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:33.667419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4284d0b84f4940c5be4a3ae50fdc3d9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:33.695053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4284d0b84f4940c5be4a3ae50fdc3d9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:33.695864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4284d0b84f4940c5be4a3ae50fdc3d9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:33.725252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1048/2115] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:33 2022] DELETE /identity/v3/users/4284d0b84f4940c5be4a3ae50fdc3d9b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:33.729762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:33.730435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:33.730528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:33.788749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:33.790063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:33.911572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1068/2116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:33.921266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:33.922730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:33.983356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:34.018069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5602f8-1316-4b0e-a8c8-966dd6050c29 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:34.023309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:34.024027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:34.024290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:34.024563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:34.036944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:34.038521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:34.061897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1049/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:34.534246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:34.537099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:34.564534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bc16b-9041-4e53-a603-198c8fc647ba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:34.581906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:34.581906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:34.582208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:34.582603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] PATH_INFO: `/v3/users/9b6951d58d1249adb3c3f10556b9e905` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:34.586235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6951d58d1249adb3c3f10556b9e905)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:34.586235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:34.627325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:34.628811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:34.653685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb6286-6f39-48ef-90a3-f2c6c64babc2 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:34.665408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:34.666411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:34.666844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:34.667678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] PATH_INFO: `/v3/projects/24abd195ad714439a19e61409e5689d7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:34.670687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24abd195ad714439a19e61409e5689d7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:34.675345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:34.686932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6951d58d1249adb3c3f10556b9e905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.715479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6951d58d1249adb3c3f10556b9e905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.783085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6951d58d1249adb3c3f10556b9e905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.784608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6951d58d1249adb3c3f10556b9e905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.785365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-118078c2-bec0-48a1-96e6-c39ec492fdf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6951d58d1249adb3c3f10556b9e905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.793966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24abd195ad714439a19e61409e5689d7', 'request_id': 'req-1be38f0f-c593-4f13-9f04-370637a6e2b3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.817054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24abd195ad714439a19e61409e5689d7', 'request_id': 'req-1be38f0f-c593-4f13-9f04-370637a6e2b3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.826907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1069/2118] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:34 2022] DELETE /identity/v3/users/9b6951d58d1249adb3c3f10556b9e905 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:34.832081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:34.832377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:34.832489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24abd195ad714439a19e61409e5689d7', 'request_id': 'req-1be38f0f-c593-4f13-9f04-370637a6e2b3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.832657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:34.855186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] The token cache is being invalidate because project 24abd195ad714439a19e61409e5689d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:34.855855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.856824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:34.859769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1050/2119] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:34 2022] DELETE /identity/v3/projects/24abd195ad714439a19e61409e5689d7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:34.902161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:34.902161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:34.935920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:34.937823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.058132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:35.095339 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1070/2120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:35.135634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:35.139317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.165327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be38f0f-c593-4f13-9f04-370637a6e2b3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:35.181972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:35.187049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.187339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.187600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] PATH_INFO: `/v3/users/bdc653acaa2e41b9b4820f81680c3c69` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.189462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc653acaa2e41b9b4820f81680c3c69)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:35.191534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:35.293917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc653acaa2e41b9b4820f81680c3c69'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.294660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc653acaa2e41b9b4820f81680c3c69'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.296814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74ac4-25aa-4274-a8fb-c881227aa39d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:35.300658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:35.301724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.302004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.302330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.303186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc653acaa2e41b9b4820f81680c3c69'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.304359 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.314677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:35.320551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:35.321456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc653acaa2e41b9b4820f81680c3c69'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.322186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8aea-8403-4974-829e-c5a01f24ba47 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:35.322327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ba36808-146c-4b1e-9cfc-b1864409882c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc653acaa2e41b9b4820f81680c3c69'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.340816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1051/2121] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:34 2022] DELETE /identity/v3/users/bdc653acaa2e41b9b4820f81680c3c69 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:35.342300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.342670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.343256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.343779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1071/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:35.347866 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.348353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.348817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.374994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:35.376716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.380435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] MFA Rules not processed for user `6bb8f9c24bbf460dab2bfb8ae539b374`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:35.382069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.458456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1072/2123] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:35.470928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:35.472587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.485863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1052/2124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:35.493639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:35.495903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.549111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1d129-0bec-447e-badc-cf7677f15d0e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:35.553275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:35.554558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.555064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.555480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.567928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:35.569391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:35.585479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1073/2125] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:35.607714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738a20-7772-4021-9c40-ca147ebc6be8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:35.614191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:35.614933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.615276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.615611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.625772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:35.628300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee74e4-7ad1-4344-a7e3-94583f9787c2 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:35.642336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1053/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:35.709987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:35.711786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.762916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef6e9-2111-4867-8a5f-b32de990b37d service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:35.770175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:35.771134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.771561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.772050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] PATH_INFO: `/v3/projects/7b35ffe23c8b4e03b0b8234abbc4fee7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.773309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b35ffe23c8b4e03b0b8234abbc4fee7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:35.775567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:35.848587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:35.866998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b35ffe23c8b4e03b0b8234abbc4fee7', 'request_id': 'req-69d78f24-aee9-4121-948d-d57415928ed1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.880026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b35ffe23c8b4e03b0b8234abbc4fee7', 'request_id': 'req-69d78f24-aee9-4121-948d-d57415928ed1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.889227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b35ffe23c8b4e03b0b8234abbc4fee7', 'request_id': 'req-69d78f24-aee9-4121-948d-d57415928ed1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.906001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] The token cache is being invalidate because project 7b35ffe23c8b4e03b0b8234abbc4fee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:35.906508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.907826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:35.910331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1074/2127] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:35 2022] DELETE /identity/v3/projects/7b35ffe23c8b4e03b0b8234abbc4fee7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:35.917953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615d946-3319-41a1-9f09-b8e609dd041e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:35.918584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615d946-3319-41a1-9f09-b8e609dd041e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:35.919168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615d946-3319-41a1-9f09-b8e609dd041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:35.960887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a615d946-3319-41a1-9f09-b8e609dd041e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:35.963880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:35.967089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:35.970124 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a615d946-3319-41a1-9f09-b8e609dd041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:36.069945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:36.092619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1054/2128] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:36.105713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.105713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.105713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.143818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:36.145188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:36.154559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1055/2129] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:36.160722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.178057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd148198-8c09-4ffb-9812-08b9f90e3757 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.185971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.186636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d78f24-aee9-4121-948d-d57415928ed1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.187175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.187563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.188106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.189071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:36.189573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.194368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.204847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.205888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.206323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.206726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] PATH_INFO: `/v3/projects/50b16b35dfb24493b883a10d93c8263a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.213593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b16b35dfb24493b883a10d93c8263a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.217728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.219469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1056/2130] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:36.228180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.245881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89d9ef-c761-4c0d-931b-2bd04c66af44 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.260881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.262184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.262734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.263299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.264644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.267868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.343303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1057/2131] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:36 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:36.347693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b16b35dfb24493b883a10d93c8263a', 'request_id': 'req-f54b3379-b097-495b-ba9d-6ba708a427df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.348673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.371555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b16b35dfb24493b883a10d93c8263a', 'request_id': 'req-f54b3379-b097-495b-ba9d-6ba708a427df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.393226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b16b35dfb24493b883a10d93c8263a', 'request_id': 'req-f54b3379-b097-495b-ba9d-6ba708a427df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.428696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] The token cache is being invalidate because project 50b16b35dfb24493b883a10d93c8263a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:36.429582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.432224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.438298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1075/2132] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:35 2022] DELETE /identity/v3/projects/50b16b35dfb24493b883a10d93c8263a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:36.441549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.443712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:36.495573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7162-4b80-43ca-945e-006ba0e43e35 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.512527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.514197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.514620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.514981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.515977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.518015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.570176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:36.578292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1058/2133] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:36 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:36.583886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b3379-b097-495b-ba9d-6ba708a427df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.585904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.589416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:36.594649 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.598552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.598792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.599066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] PATH_INFO: `/v3/users/11683f1d6efb4b4986ee635128be50ba` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.600645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11683f1d6efb4b4986ee635128be50ba)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.602637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.615049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcf20f-cd41-4348-8345-acc24ff5e655 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.622196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.622900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.623181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.623449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.624096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.626345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.645008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1059/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:36.646752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.664752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ce1c-90db-46e0-a44b-3aab55d0034c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.677199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.678008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.678489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.679862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.680149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.684458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.698848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11683f1d6efb4b4986ee635128be50ba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.712077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1060/2135] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:36.716159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.720163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11683f1d6efb4b4986ee635128be50ba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.729000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527c9d3-937f-4b0c-aeb9-c660a11204e7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:36.735538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:36.736627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.736627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.736912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] PATH_INFO: `/v3/projects/4c0c80266a2648daae4370939e6f5f2c/users/ad274e727fa44791b1ed45830d8826bd/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.746021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11683f1d6efb4b4986ee635128be50ba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.746973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11683f1d6efb4b4986ee635128be50ba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.748637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-681ba320-cfd0-46f3-b941-5dce5456cbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11683f1d6efb4b4986ee635128be50ba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:36.768973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0c80266a2648daae4370939e6f5f2c, user_id=ad274e727fa44791b1ed45830d8826bd, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:36.770804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1076/2136] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:36 2022] DELETE /identity/v3/users/11683f1d6efb4b4986ee635128be50ba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:36.776014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:36.795653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1061/2137] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:36 2022] PUT /identity/v3/projects/4c0c80266a2648daae4370939e6f5f2c/users/ad274e727fa44791b1ed45830d8826bd/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:36.807221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:36.807684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:36.808152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:36.849004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] MFA Rules not processed for user `ad274e727fa44791b1ed45830d8826bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:36.850162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:36.938316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1077/2138] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:36.956110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:36.957938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:37.043707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1a8c-7590-40be-bf88-f6b39608eeb0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:37.049680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:37.050590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.050969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.051344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.062410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:37.065437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594503a4-074a-4802-a72a-26109faee373 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:37.077725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1062/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:37.482563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:37.484001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:37.599579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8a41d-0b67-447c-870d-0b343f1a6d31 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:37.615851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:37.616433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.616714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.616987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] PATH_INFO: `/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.619968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47be25f5a8194a9a9f23cd388f47d3e7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:37.621929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:37.645421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:37.671976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dbfc5-47dc-4f55-bc49-be4fd8e9425c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.672538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dbfc5-47dc-4f55-bc49-be4fd8e9425c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.672538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dbfc5-47dc-4f55-bc49-be4fd8e9425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.681080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:37.699715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a21dbfc5-47dc-4f55-bc49-be4fd8e9425c None None] MFA Rules not processed for user `6bb8f9c24bbf460dab2bfb8ae539b374`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:37.701269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a21dbfc5-47dc-4f55-bc49-be4fd8e9425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:37.763970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47be25f5a8194a9a9f23cd388f47d3e7', 'request_id': 'req-c6d3f416-debd-40aa-abc5-433670177f43'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:37.768574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1063/2140] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:37.777572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47be25f5a8194a9a9f23cd388f47d3e7', 'request_id': 'req-c6d3f416-debd-40aa-abc5-433670177f43'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:37.785321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47be25f5a8194a9a9f23cd388f47d3e7', 'request_id': 'req-c6d3f416-debd-40aa-abc5-433670177f43'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:37.799432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] The token cache is being invalidate because project 47be25f5a8194a9a9f23cd388f47d3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:37.800221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:37.801132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c6d3f416-debd-40aa-abc5-433670177f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:37.803574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1078/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:37 2022] DELETE /identity/v3/projects/47be25f5a8194a9a9f23cd388f47d3e7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:37.809511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.809779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.810097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.836027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:37.837302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:37.909349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1064/2142] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:37.918409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.918926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.919124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.948568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:37.949975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:37.960046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1079/2143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:37.964316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:37.975789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063daae2-1c52-42c4-a377-b8c0ca2da681 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:37.982340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:37.982934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:37.983283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:37.983626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:37.984359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:37.984605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:37.986435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.002918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1065/2144] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:38.004042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.016060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b85a8c-f1f0-4c8d-83d3-fa21c11eac5d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.021805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.022514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.022812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.023107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.023739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.025665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.065255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1080/2145] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:38.069646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.081331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee404b-9151-448d-b4ec-a40ed1574852 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.171704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.173531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.179527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.179946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.181164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.188258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.220829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1066/2146] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:38.225959 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.241809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0a2b7-cf44-4d91-813e-34064b8ec71e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.249671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.250807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.251258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.251669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.252612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.254681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.272820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1081/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:38.276763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.290498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702c7d-815e-4031-a5d1-aa0664bb8d4f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.298257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.299367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.299689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.300106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.301148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.304446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12b90d-d51d-4a78-81f5-bc8226b70b94 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.324005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.331394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1067/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:38.336904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5ba-e570-4a15-8ea0-833f9523034c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.345401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.346285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.346939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.347154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] PATH_INFO: `/v3/projects/f80a1f356e7240918605c50e38f46c39/users/88d081e35eba4a3f8ce732c6e6ab1ba7/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.379502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80a1f356e7240918605c50e38f46c39, user_id=88d081e35eba4a3f8ce732c6e6ab1ba7, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.383249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.400187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1082/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:38 2022] PUT /identity/v3/projects/f80a1f356e7240918605c50e38f46c39/users/88d081e35eba4a3f8ce732c6e6ab1ba7/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:38.411030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.411368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.411575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.439517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:38.444451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] MFA Rules not processed for user `88d081e35eba4a3f8ce732c6e6ab1ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:38.446649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:38.530361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1068/2150] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:38.531497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.630563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7264-4718-4987-941e-c10c1fc0301c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.642509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.643314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.649571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.649571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.649571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.649571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee3f2-2593-4f4e-8608-83d870970974 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.699552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1083/2151] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:38.704990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.724457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235319-d299-4fbc-8fd7-e9255de2d1bf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.836111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.836419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.837048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.842306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.843376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.843820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.845708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.846679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.850128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.869486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] MFA Rules not processed for user `b54e8fa8416f4d319aa2c7e6370c92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:38.871554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:38.892232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:38.908825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1069/2152] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:38.912987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.928862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0c002-eafa-4e79-bc9f-1888a9556111 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.943355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.944674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.945397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.946291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:38.947106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:38.950198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:38.957394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1084/2153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:38.968429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1070/2154] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:38.971656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:38.985596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5bd57-d045-4411-9b34-50a88b71fafd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:38.990931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:38.991800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:38.992251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:38.992534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] PATH_INFO: `/v3/projects/73b958015dca45c3a473df70fa2de93c/users/b0dfebb6d8dc4894adca13c53a3337d7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:39.010760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b958015dca45c3a473df70fa2de93c, user_id=b0dfebb6d8dc4894adca13c53a3337d7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:39.015298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:39.033748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1085/2155] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:38 2022] PUT /identity/v3/projects/73b958015dca45c3a473df70fa2de93c/users/b0dfebb6d8dc4894adca13c53a3337d7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:39.037717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:39.049625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e028f-6e1d-4336-9557-b04eaebbbb25 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:39.121736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:39.122599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:39.122954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:39.124123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:39.124123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:39.125701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d888c-d17e-4ede-ad4e-30c11dacaf67 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:39.144029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:39.145972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1071/2156] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:39.156334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb4af-0561-4d2c-9464-f8ac1ab6087a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:39.166077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:39.166804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:39.167085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:39.167360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] PATH_INFO: `/v3/projects/73b958015dca45c3a473df70fa2de93c/users/b0dfebb6d8dc4894adca13c53a3337d7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:39.171144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b958015dca45c3a473df70fa2de93c, user_id=b0dfebb6d8dc4894adca13c53a3337d7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:39.177383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:39.193658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1086/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:39 2022] PUT /identity/v3/projects/73b958015dca45c3a473df70fa2de93c/users/b0dfebb6d8dc4894adca13c53a3337d7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:39.203878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:39.204544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:39.204544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:39.308859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] MFA Rules not processed for user `b0dfebb6d8dc4894adca13c53a3337d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:39.311065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:39.325157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:39.417571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1072/2158] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:39.430293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:39.432293 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:39.509771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895136f-849c-44c9-a7f6-64a1cb21d08b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:39.524021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:39.524958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:39.525358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:39.526254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:39.613648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:39.615337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:39.628404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1087/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:44.532255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:44.533775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:44.545810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901bbd4-5f35-4a1f-bef8-2b753e0ee1d7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:44.549395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:44.550008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:44.550306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:44.550585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:44.560590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:44.561958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218540ee-e11c-4839-b4c4-bf27de32cadd service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:44.572653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1073/2160] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:49.183869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:49.185528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.253721 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:49.287083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433274-9965-4998-8f07-2b1bf3b85407 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:49.291974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:49.292623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.292987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.293262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] PATH_INFO: `/v3/users/ad274e727fa44791b1ed45830d8826bd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.294564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad274e727fa44791b1ed45830d8826bd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:49.296463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:49.353678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad274e727fa44791b1ed45830d8826bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.361176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad274e727fa44791b1ed45830d8826bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.373515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad274e727fa44791b1ed45830d8826bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.374245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad274e727fa44791b1ed45830d8826bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.374879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad274e727fa44791b1ed45830d8826bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.388031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1088/2161] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:49 2022] DELETE /identity/v3/users/ad274e727fa44791b1ed45830d8826bd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:49.393069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.393563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.393679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.414028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:49.415300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.478931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1074/2162] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:49.488498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:49.490014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.553193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fcc16-a33b-4201-b243-c0ad42cb15e5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:49.557912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:49.558483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.558763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.559035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.564518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:49.565984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.577398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:49.578906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c809b1-eff1-4c9e-87ae-d244d1cb9049 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:49.579735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0261-e858-4b1e-ae93-2ba13eb97b17 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:49.584446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:49.585077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.585493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.586038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] PATH_INFO: `/v3/users/88d081e35eba4a3f8ce732c6e6ab1ba7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.587248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d081e35eba4a3f8ce732c6e6ab1ba7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:49.589280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:49.590246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1089/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:49.637650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d081e35eba4a3f8ce732c6e6ab1ba7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.638946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d081e35eba4a3f8ce732c6e6ab1ba7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.646133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d081e35eba4a3f8ce732c6e6ab1ba7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.658837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d081e35eba4a3f8ce732c6e6ab1ba7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.659535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d081e35eba4a3f8ce732c6e6ab1ba7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:49.672826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1075/2164] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:49 2022] DELETE /identity/v3/users/88d081e35eba4a3f8ce732c6e6ab1ba7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:49.677249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.677527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.677796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.705806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:49.708389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.785642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1090/2165] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:49.798122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:49.800065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.806184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:49.871065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f47cc5-dd42-402e-b9e1-3780b5a4bb5c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:49.875904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:49.876659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.877119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.877408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.889543 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:49.891415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:49.892175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f4ff-70ea-49e8-b9c3-6a600ab90760 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:49.893861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:49.908151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1076/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:49.908573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:49.916919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013519-bbb1-4e72-984c-618ac10bfd16 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:49.935092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:49.936427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:49.936774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:49.936983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] PATH_INFO: `/v3/projects/4c0c80266a2648daae4370939e6f5f2c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:49.938978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0c80266a2648daae4370939e6f5f2c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:49.942229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.016128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0c80266a2648daae4370939e6f5f2c', 'request_id': 'req-ef07928c-23b7-4e64-809b-2706adecb182'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.025480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0c80266a2648daae4370939e6f5f2c', 'request_id': 'req-ef07928c-23b7-4e64-809b-2706adecb182'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.032398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0c80266a2648daae4370939e6f5f2c', 'request_id': 'req-ef07928c-23b7-4e64-809b-2706adecb182'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.043753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] The token cache is being invalidate because project 4c0c80266a2648daae4370939e6f5f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:50.043966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.045213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef07928c-23b7-4e64-809b-2706adecb182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.048548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1091/2167] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:49 2022] DELETE /identity/v3/projects/4c0c80266a2648daae4370939e6f5f2c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:50.053370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.053658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.053957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.082096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:50.082096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.144876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1077/2168] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:50.152675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.152960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.153238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.173373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:50.174646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.182872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1092/2169] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:50.187205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.197293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b700d3-2f19-4f55-b158-53bbfa5c0b81 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.202864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.203491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.203825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.204142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.204859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:50.205237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.206979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.214446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.216010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.221507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1078/2170] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:50.226210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.229338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c55e-fa56-47c2-a354-ee6b9defaf24 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.234177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.234873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.235152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.235421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] PATH_INFO: `/v3/projects/f80a1f356e7240918605c50e38f46c39` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.237269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535146d9-e322-4e53-89b0-1f33d57b6982 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.237648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80a1f356e7240918605c50e38f46c39)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.239656 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.241941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.242573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.242848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.243172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.243722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.245595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.278605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1079/2171] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:50.279659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.292013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80a1f356e7240918605c50e38f46c39', 'request_id': 'req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.302619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80a1f356e7240918605c50e38f46c39', 'request_id': 'req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.310702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80a1f356e7240918605c50e38f46c39', 'request_id': 'req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.328820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] The token cache is being invalidate because project f80a1f356e7240918605c50e38f46c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:50.329117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.329835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.333480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1093/2172] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:50 2022] DELETE /identity/v3/projects/f80a1f356e7240918605c50e38f46c39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:50.337273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.339122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.363600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11aa57-f2d6-4ce3-b44d-a9474a707162 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.379910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:50.415175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb15ab-ba71-4947-adfe-a0c8d7c44155 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.419993 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.420772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.421056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.421397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] PATH_INFO: `/v3/users/b0dfebb6d8dc4894adca13c53a3337d7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.423031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0dfebb6d8dc4894adca13c53a3337d7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.424557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.427496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:50.435506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.436246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.436572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.436919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.437675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.439740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.466076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1080/2173] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:50.470983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.473335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.485910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d0ae-5bba-4032-82ec-ebc205d7eb4d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.493956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.494778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.495061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.498182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0dfebb6d8dc4894adca13c53a3337d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.507747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0dfebb6d8dc4894adca13c53a3337d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.507899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.509198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.510886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.527030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0dfebb6d8dc4894adca13c53a3337d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.527940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0dfebb6d8dc4894adca13c53a3337d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.528878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0dfebb6d8dc4894adca13c53a3337d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:50.533504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1081/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:50.543749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1094/2175] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:50 2022] DELETE /identity/v3/users/b0dfebb6d8dc4894adca13c53a3337d7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:50.545928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.549290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.563811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4df5-7450-44a3-973c-e53e0c33a3cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.636752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.637465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.637819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.638945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.639747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.641661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d6e9e-fda2-4d84-baba-d1c4c9b5f3e2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.656397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1082/2176] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:50.660490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.671807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279aabe-7920-4f7b-95c4-8eda29b13424 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.677876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.678594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.678867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.679388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] PATH_INFO: `/v3/projects/2ae10d1e9d5a44c3975ad149cb8621c3/users/568f6a80f98443659804b469d0c35688/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.696292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae10d1e9d5a44c3975ad149cb8621c3, user_id=568f6a80f98443659804b469d0c35688, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.699073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.713136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1095/2177] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:50 2022] PUT /identity/v3/projects/2ae10d1e9d5a44c3975ad149cb8621c3/users/568f6a80f98443659804b469d0c35688/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:50.724482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.724761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.725031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.754043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] MFA Rules not processed for user `568f6a80f98443659804b469d0c35688`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:50.755289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.824937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1083/2178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:50.829476 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.896337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.900009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:50.911015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc9a60-de49-41f5-9e40-9cd0ebe71023 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.920979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.921612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.921887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.922157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.922828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.924738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.932480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cdbb-831f-44ad-890c-c317844975c3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:50.939826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:50.940434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:50.940722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:50.941161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] PATH_INFO: `/v3/projects/73b958015dca45c3a473df70fa2de93c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:50.944059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b958015dca45c3a473df70fa2de93c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:50.946605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:50.957521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1096/2179] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:50.963021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:50.972110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:51.028354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b958015dca45c3a473df70fa2de93c', 'request_id': 'req-d713ebd1-7315-4956-907d-c46ce2aba7c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:51.034943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:51.050776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b958015dca45c3a473df70fa2de93c', 'request_id': 'req-d713ebd1-7315-4956-907d-c46ce2aba7c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:51.061863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b958015dca45c3a473df70fa2de93c', 'request_id': 'req-d713ebd1-7315-4956-907d-c46ce2aba7c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:51.073778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87a46-5e4c-407b-8454-2bd3b9343055 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.075352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] The token cache is being invalidate because project 73b958015dca45c3a473df70fa2de93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:51.075843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:51.076672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d713ebd1-7315-4956-907d-c46ce2aba7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:51.078902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1084/2180] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:50 2022] DELETE /identity/v3/projects/73b958015dca45c3a473df70fa2de93c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:51.100222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f350f0-9e7d-4473-91cb-dbd26a892f85 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.101489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f350f0-9e7d-4473-91cb-dbd26a892f85 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.101772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f350f0-9e7d-4473-91cb-dbd26a892f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.157354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b4f350f0-9e7d-4473-91cb-dbd26a892f85 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:51.158924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b4f350f0-9e7d-4473-91cb-dbd26a892f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.172714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.173331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.173607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.173876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.174552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.176451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.203463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1097/2181] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:50 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:51.207793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.209944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.224050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab057aba-aa27-4287-b15a-623a9a274a82 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.233465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.238902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.239196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.239455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.240115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.241777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.246301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1085/2182] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:51.251681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.251970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.252264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.256257 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1098/2183] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:51.257335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.267861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76536dd8-5774-47e8-9eec-a8015d9e1b08 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.272426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:51.272703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.273305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.273585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.273714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.273853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.274538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.276123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.283242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1086/2184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:51.287375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.287826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1099/2185] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:51.291668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.301206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc720fb-e1fb-4f22-9c2f-0e7c2e7caf12 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.302627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23296c-d6e0-4c60-809e-77629f261ac1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.306260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.307910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.308657 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.309136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.309499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] PATH_INFO: `/v3/projects/c8037c6bbd5044f6a686d034e434fffc/users/0b4562c695f7483c934a78383c445e06/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.311012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.311450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.311886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.312906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:51.313377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.316088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.337404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1087/2186] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:51.342374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.353732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ea26-7d47-4629-979f-ac84a61593b5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.354466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8037c6bbd5044f6a686d034e434fffc, user_id=0b4562c695f7483c934a78383c445e06, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.357511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151876-ac5d-462c-b6f3-501bf43650c3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.358736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.360699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.360699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.360699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.360699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.363019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.384541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1100/2187] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:51 2022] PUT /identity/v3/projects/c8037c6bbd5044f6a686d034e434fffc/users/0b4562c695f7483c934a78383c445e06/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:51.387225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.387584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.387902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.425053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1088/2188] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:51.426528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.429903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] MFA Rules not processed for user `0b4562c695f7483c934a78383c445e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:51.431390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.520380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1101/2189] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:51.524651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.524862 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d2cc-a1f4-4211-bf57-de3cea0e4041 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.530706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.531326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.531607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.531885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.532587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.534550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.539869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c1646-0057-460a-84af-bd6fc5148185 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.545752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:51.545971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.547571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.548012 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.548438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.549394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.552162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.564545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1089/2190] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:51.569063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.581366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:51.584134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e09aa-fe5a-4405-9429-e1a66e73a0ae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.589491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.590101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.590229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1102/2191] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:08:51.590336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.590869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.591898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.593828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.595209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.605017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1090/2192] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:51.609085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.621211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac913f-f99d-4a2d-89e0-3c4688d618fa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.684820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.685762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.686035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550e8b-e6c1-4ae0-9fbe-8e28c2da0268 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.686163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.686523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.687367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.689076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.691688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.692299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.692572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.693163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.693796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.695739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.704363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1091/2193] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:51.708408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.718938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1103/2194] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:51.722724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.723275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d888ff-cb2e-4ec8-b83e-76412e71b21c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.728080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.728736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.729015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.729291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] PATH_INFO: `/v3/projects/138ecca70f6346f4a878700b778e0276/users/30a8dcd6ffa94b03b662754d3a1c556b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.732964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e964aad-4803-4baf-af41-d4adfed8ca2d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.737496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.738093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.738394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.738667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.739415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.741018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.745978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138ecca70f6346f4a878700b778e0276, user_id=30a8dcd6ffa94b03b662754d3a1c556b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.750078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a3f1-5e7a-4546-9a22-0f3c67604911 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.751810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1104/2195] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:08:51.756066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.768163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43d1b8-990b-495e-a43e-7437c2465fdc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.769591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1092/2196] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:51 2022] PUT /identity/v3/projects/138ecca70f6346f4a878700b778e0276/users/30a8dcd6ffa94b03b662754d3a1c556b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:51.781305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.781581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.781963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.812399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] MFA Rules not processed for user `30a8dcd6ffa94b03b662754d3a1c556b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:51.813622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.856661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.857384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.857702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.858042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] PATH_INFO: `/v3/projects/513a2e09f11149abb7969d605fa3f84b/users/06a35326b5ce4aae9c47921e4cc98d14/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.875838 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513a2e09f11149abb7969d605fa3f84b, user_id=06a35326b5ce4aae9c47921e4cc98d14, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.878715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:51.885658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1093/2197] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:51.895636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1105/2198] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:51 2022] PUT /identity/v3/projects/513a2e09f11149abb7969d605fa3f84b/users/06a35326b5ce4aae9c47921e4cc98d14/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:51.897692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.899116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:51.907979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:51.960707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:51.974550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eada0-9da8-4fae-88ca-8341c76da729 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.988832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3264f2-d968-4062-ad66-5c8c7c9eb367 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:51.994564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:51.995183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:51.995466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:51.995736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:51.996383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:51.998524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:52.001354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:52.015602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1106/2199] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:52.018002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:52.028820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a517-cc69-46c0-bb1d-61bd94f7ccc4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:52.033504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:52.034158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:52.034463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:52.034733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] PATH_INFO: `/v3/projects/513a2e09f11149abb7969d605fa3f84b/users/06a35326b5ce4aae9c47921e4cc98d14/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:52.036762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=513a2e09f11149abb7969d605fa3f84b, user_id=06a35326b5ce4aae9c47921e4cc98d14, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:52.039563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f1351-a25c-45cd-855b-53780af62dee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:52.042733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:52.043337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:52.043620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:52.043926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:52.054403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1107/2200] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:52 2022] PUT /identity/v3/projects/513a2e09f11149abb7969d605fa3f84b/users/06a35326b5ce4aae9c47921e4cc98d14/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:52.062383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:52.062679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:52.062957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:52.096223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] MFA Rules not processed for user `06a35326b5ce4aae9c47921e4cc98d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:52.097597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:52.107818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:52.109204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:52.118772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1094/2201] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:52.168633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1108/2202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:52.181163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:52.182896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:52.194881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d6df6-cf79-4e89-a093-65d5ddf1239f service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:52.255454 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:52.256076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:52.256736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:52.257033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:52.259055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:52.333292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:52.335486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:52.346637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1095/2203] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:54.038161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:54.050965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33431737-44d1-4aa0-b5cd-17cf0be486e1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:54.055355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:54.056180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:54.056578 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:54.056944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:54.147291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:54.149515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:54.164086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1109/2204] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:54.864689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:54.873650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817836c0-f70c-4884-a83b-cda421a96d1b service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:54.877232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:54.877821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:54.878242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:54.878390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:54.886614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:54.888050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:54.889749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec606bef-042a-47ce-b883-4a1f9d39b49c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:54.900005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1096/2205] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:57.613643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:57.679332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751b6c1-d751-4c32-8d6f-f847d8714d94 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:57.684110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:57.685309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:57.685582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:57.685861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] PATH_INFO: `/v3/users/30a8dcd6ffa94b03b662754d3a1c556b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:57.687261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a8dcd6ffa94b03b662754d3a1c556b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:57.689563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:57.701797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:57.742073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a8dcd6ffa94b03b662754d3a1c556b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:57.749159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a8dcd6ffa94b03b662754d3a1c556b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:57.761168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a8dcd6ffa94b03b662754d3a1c556b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:57.761854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a8dcd6ffa94b03b662754d3a1c556b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:57.762501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a8dcd6ffa94b03b662754d3a1c556b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:57.775403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1110/2206] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:57 2022] DELETE /identity/v3/users/30a8dcd6ffa94b03b662754d3a1c556b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:57.780380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:57.780852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:57.781032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:57.801192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:57.802503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:57.863044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1097/2207] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:57.872565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:57.873955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:57.933348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5284-14a5-490e-a9e9-af140eb99267 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:57.938872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:57.939489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:57.939762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:57.940039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:57.950617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:57.952220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293b9e-6a7c-4b93-b72d-effbebf385fa service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:57.961831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1111/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:08:58.290308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.291952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.311031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754cbfa-4568-4a90-92f4-ee1df6e71d48 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.322662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.323449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.323936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.324437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] PATH_INFO: `/v3/projects/138ecca70f6346f4a878700b778e0276` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.326991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=138ecca70f6346f4a878700b778e0276)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.329263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.384372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138ecca70f6346f4a878700b778e0276', 'request_id': 'req-25135d2b-60aa-4f4f-b076-8ae829bb0dac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.392093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138ecca70f6346f4a878700b778e0276', 'request_id': 'req-25135d2b-60aa-4f4f-b076-8ae829bb0dac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.398311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138ecca70f6346f4a878700b778e0276', 'request_id': 'req-25135d2b-60aa-4f4f-b076-8ae829bb0dac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.411445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] The token cache is being invalidate because project 138ecca70f6346f4a878700b778e0276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:58.411737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.412447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25135d2b-60aa-4f4f-b076-8ae829bb0dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.413930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1098/2209] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:58 2022] DELETE /identity/v3/projects/138ecca70f6346f4a878700b778e0276 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:58.419553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.419941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.420371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.440742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:58.441995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.502672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1112/2210] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:58.511496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.511785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.512062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.532356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:58.533583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.541819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1099/2211] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:58.545898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.557240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c41b9b-473d-4889-adb8-21859877a0a7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.561226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.561828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.562101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.562401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.563040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:08:58.563377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.564908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.577900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1113/2212] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:08:58.582252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.592049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb222f-ee06-43b9-9cb9-7b19fd21e7fe None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.596705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.597292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.597566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.597831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.598475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.604982 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.643336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1100/2213] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:58.644462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.655888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad4de-f571-4513-a81c-55f2e6dcfbde admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.668474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:58.718350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.718964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.719245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.719515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.720136 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.722073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.745907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1114/2214] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:08:58.747845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.761910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784807a3-045d-4c7f-b915-b35ff0ba4628 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.769249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.769996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.770384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.770735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.771451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.773135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.788192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1101/2215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:58.789014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.800345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec3dab-5c29-4722-9647-f154335db3e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.810568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.811199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.811478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.811748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.812414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.814048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.826329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1115/2216] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:08:58.830449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.834940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.836772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.843682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba9d4-73a4-4c25-9766-ec80ae2e93e4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.848690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.849344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.849627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.849904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] PATH_INFO: `/v3/projects/8f58d481a435486cbb4e81c2a1d4aee8/users/3210c71488674ffcbdb2f8651dd45a90/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.850005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd813b-0a89-4947-95e9-909f4204d387 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:58.854680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:58.855316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.855593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.855861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] PATH_INFO: `/v3/users/568f6a80f98443659804b469d0c35688` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.857529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f6a80f98443659804b469d0c35688)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.859472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.865203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f58d481a435486cbb4e81c2a1d4aee8, user_id=3210c71488674ffcbdb2f8651dd45a90, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:58.868023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908325b-7c4e-477b-ab7a-ba62ed653dc6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:58.881756 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1102/2217] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:08:58 2022] PUT /identity/v3/projects/8f58d481a435486cbb4e81c2a1d4aee8/users/3210c71488674ffcbdb2f8651dd45a90/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:58.886618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.886891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.887187 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.908327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:58.909660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.912602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f6a80f98443659804b469d0c35688'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.918852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:58.920724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f6a80f98443659804b469d0c35688'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.933447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f6a80f98443659804b469d0c35688'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.934154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f6a80f98443659804b469d0c35688'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.935525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be93c6b-aec9-4827-9f40-802e38f103e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f6a80f98443659804b469d0c35688'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:58.951041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1116/2218] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:58 2022] DELETE /identity/v3/users/568f6a80f98443659804b469d0c35688 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:08:58.955362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:58.955648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:58.955954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:58.977047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:58.978296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:58.984847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1103/2219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:58.992558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:58.994072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:59.049412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1117/2220] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:08:59.057931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf84bd-1e24-4336-90f6-0320eb718217 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:59.059363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:59.061279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:59.071936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:59.108487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:59.109112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:59.109392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:59.109686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:59.119464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:59.121054 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:59.125633 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896594af-8cd2-4a10-801d-8cf7e95c9f9f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:59.129357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:59.129969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:59.130246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:59.130545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:59.131282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1104/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:59.140929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:59.142394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:59.152383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1118/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:08:59.441946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:59.443573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:59.457264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec065bb-4058-4926-a84e-afa0198d4304 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:59.462928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:59.463846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:59.464180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:59.464580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] PATH_INFO: `/v3/projects/2ae10d1e9d5a44c3975ad149cb8621c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:59.467559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae10d1e9d5a44c3975ad149cb8621c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:59.470324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:59.524034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae10d1e9d5a44c3975ad149cb8621c3', 'request_id': 'req-1b4cf6a6-b76f-478f-990c-6a5c427105a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.532659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae10d1e9d5a44c3975ad149cb8621c3', 'request_id': 'req-1b4cf6a6-b76f-478f-990c-6a5c427105a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.539706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae10d1e9d5a44c3975ad149cb8621c3', 'request_id': 'req-1b4cf6a6-b76f-478f-990c-6a5c427105a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.548487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:08:59.556027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] The token cache is being invalidate because project 2ae10d1e9d5a44c3975ad149cb8621c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:08:59.556405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.557306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4cf6a6-b76f-478f-990c-6a5c427105a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.559687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1105/2223] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:08:59 2022] DELETE /identity/v3/projects/2ae10d1e9d5a44c3975ad149cb8621c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:59.564196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:59.586142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0c03-dfa7-47df-945a-101f8f3a3f86 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:08:59.657392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:08:59.658183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:59.658528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:59.658801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] PATH_INFO: `/v3/users/0b4562c695f7483c934a78383c445e06` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:59.660297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4562c695f7483c934a78383c445e06)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:08:59.663116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:08:59.722826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:08:59.723315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:08:59.723761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:08:59.726185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4562c695f7483c934a78383c445e06'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.735680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4562c695f7483c934a78383c445e06'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.746196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:08:59.748291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:59.750574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4562c695f7483c934a78383c445e06'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.751392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4562c695f7483c934a78383c445e06'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.752061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4562c695f7483c934a78383c445e06'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:08:59.768391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1119/2224] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:08:59 2022] DELETE /identity/v3/users/0b4562c695f7483c934a78383c445e06 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:08:59.815391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1106/2225] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:08:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:08:59.874150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:08:59.878665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:08:59.956550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:00.046624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a0d4-8a14-45ba-9ef6-746453d8344e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:00.052572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:00.053283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:00.054351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:00.054351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:00.150408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:00.154988 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:00.163625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:00.174116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:00.188016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1120/2226] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:09:00.189414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be7489-99ea-4f71-a773-2841773f5f0d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:00.346595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:00.347595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:00.350725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:00.351219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] PATH_INFO: `/v3/projects/c8037c6bbd5044f6a686d034e434fffc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:00.353617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8037c6bbd5044f6a686d034e434fffc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:00.355809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:00.508010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8037c6bbd5044f6a686d034e434fffc', 'request_id': 'req-76e7052c-28f5-430b-8571-c363f1c09bcf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.527828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8037c6bbd5044f6a686d034e434fffc', 'request_id': 'req-76e7052c-28f5-430b-8571-c363f1c09bcf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.540517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8037c6bbd5044f6a686d034e434fffc', 'request_id': 'req-76e7052c-28f5-430b-8571-c363f1c09bcf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.568228 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] The token cache is being invalidate because project c8037c6bbd5044f6a686d034e434fffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:00.568957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.570840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.574038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1107/2227] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:00 2022] DELETE /identity/v3/projects/c8037c6bbd5044f6a686d034e434fffc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:00.579028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:00.597399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80209-7d1d-40d2-96bb-306b99fa4f60 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:00.693142 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:00.694208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:00.694413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:00.694910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] PATH_INFO: `/v3/users/06a35326b5ce4aae9c47921e4cc98d14` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:00.696449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a35326b5ce4aae9c47921e4cc98d14)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:00.700074 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:00.841678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a35326b5ce4aae9c47921e4cc98d14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.850051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a35326b5ce4aae9c47921e4cc98d14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.873084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a35326b5ce4aae9c47921e4cc98d14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.873831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a35326b5ce4aae9c47921e4cc98d14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.874618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-af2b2da0-5948-4c21-982b-1d38deb5aa9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a35326b5ce4aae9c47921e4cc98d14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:00.884956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:00.918756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1121/2228] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:09:00 2022] DELETE /identity/v3/users/06a35326b5ce4aae9c47921e4cc98d14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:02.000829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.003470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:02.024248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7052c-28f5-430b-8571-c363f1c09bcf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.084787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:02.157106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.158127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.159458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.159833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] PATH_INFO: `/v3/projects/513a2e09f11149abb7969d605fa3f84b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.165546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] RBAC: Authorizing `identity:delete_project(project_id=513a2e09f11149abb7969d605fa3f84b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.172924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.277702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513a2e09f11149abb7969d605fa3f84b', 'request_id': 'req-ac158c09-7880-4e67-a216-13a5876c09af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:02.296274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513a2e09f11149abb7969d605fa3f84b', 'request_id': 'req-ac158c09-7880-4e67-a216-13a5876c09af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:02.307768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513a2e09f11149abb7969d605fa3f84b', 'request_id': 'req-ac158c09-7880-4e67-a216-13a5876c09af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:02.329077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] The token cache is being invalidate because project 513a2e09f11149abb7969d605fa3f84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:02.329778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:02.331143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac158c09-7880-4e67-a216-13a5876c09af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:02.333452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1108/2229] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:01 2022] DELETE /identity/v3/projects/513a2e09f11149abb7969d605fa3f84b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:02.340213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.341328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.341328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.381410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:02.385138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:02.494845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1122/2230] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:02.502700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.502990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.503265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.525810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:02.527120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:02.536901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1109/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:02.541475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.563734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33588dd2-086b-4d0a-ad2a-6a30445bdacb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.573218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.574646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.575710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.577011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.577011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:09:02.578884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.579714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.596228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1123/2232] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:09:02.601930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.629463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedc54e-b487-400d-affa-b4b9bb5bdd08 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.634794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.635524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.635915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.636257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.637143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.639805 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.691910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1110/2233] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:09:02 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:02.693540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.718120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9731f-b773-4df1-91c8-b791a1d5a45c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.814209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.815165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.815604 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.816148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.816949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.819261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.860682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1124/2234] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:09:02 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:09:02.865308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.879698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1cbbf-64d2-4a0a-9440-613e5b5b74e0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.890791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.895125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.896100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.896722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.897771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.900043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.914546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1111/2235] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:02.918720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.933274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e466-ad74-44bc-9cc3-77581abaf1db admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.944363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:02.945311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:02.945745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:02.946398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:02.947227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:02.951737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f082c4-f419-4e1d-984a-29b1364793e1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:02.965306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1125/2236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:02.969407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:02.981932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3133a-ec38-41a9-bc51-4c1c9f047b22 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:02.999380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.000626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.000913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.001475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] PATH_INFO: `/v3/projects/726041ff1b0140929d38513f4959a118/users/ed62709e30e64c23afd8ce090a818580/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.037196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=726041ff1b0140929d38513f4959a118, user_id=ed62709e30e64c23afd8ce090a818580, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.061952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:03.089559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1112/2237] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:02 2022] PUT /identity/v3/projects/726041ff1b0140929d38513f4959a118/users/ed62709e30e64c23afd8ce090a818580/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:03.091427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.091823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.092175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.134364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] MFA Rules not processed for user `ed62709e30e64c23afd8ce090a818580`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:03.135875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:03.214241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:03.262634 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1126/2238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:03.267480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:03.403438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ecaf-9c61-4db3-bb04-9cd5737cde4b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:03.410971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.411986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.412656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.413140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.414590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.416984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:03.423940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:03.477456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1113/2239] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:03.481796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:03.501808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8ecf-465c-4210-9968-3c53cb33c725 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:03.625055 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.652237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.654912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.655414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.656480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.658697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:03.737615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1127/2240] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:09:03 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:09:03.740439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:03.758339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652185a0-3d40-4abc-967f-04925e711cb3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:03.774926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.775715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.776091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.776471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.779076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.784334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:03.811956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1114/2241] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:03.814965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:03.831404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15463fc-f24d-4434-b583-f59efb79d6ff admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:03.843353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.845088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.846448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.846836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.850418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.853183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8777-719e-43f5-9661-dc1a1956d0e1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:03.883965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1128/2242] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:09:03.885567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:03.900111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec30b-c976-4bdb-afea-4cdded57df16 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:03.910761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:03.914460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:03.914870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:03.915458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] PATH_INFO: `/v3/projects/83dcbf03295b458c9d60b3797fff16b3/users/728c140d3d0b4070bb64fe4d3ee1d93b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:03.955542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dcbf03295b458c9d60b3797fff16b3, user_id=728c140d3d0b4070bb64fe4d3ee1d93b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:03.958525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:04.027008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1115/2243] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:03 2022] PUT /identity/v3/projects/83dcbf03295b458c9d60b3797fff16b3/users/728c140d3d0b4070bb64fe4d3ee1d93b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:09:04.130549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:04.130865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:04.131191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:04.204146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] MFA Rules not processed for user `728c140d3d0b4070bb64fe4d3ee1d93b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:04.204995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:04.366453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1129/2244] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:04.370981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:04.506704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17608-596d-494d-860b-f20d5528e4d0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:04.518007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:04.520515 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:04.520776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:04.521067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:04.522179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:04.523670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:04.597907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1116/2245] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:09:04 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:04.602167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:04.628474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f3fb-4a7e-4bf5-975a-fc808335c42f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:04.733815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:04.781810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:04.782783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:04.783318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:04.783846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:04.784772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:04.789043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:04.840402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1130/2246] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:09:04 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:04.844040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:04.864950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205189e-9703-4c20-a04c-3a96f46fd327 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:04.879332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:04.879968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:04.880246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:04.880521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:04.881175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:04.882818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:04.907300 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1117/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:04.912587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:04.935909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019639e-8942-4838-a31f-d690f33f4adf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:04.960817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:04.961519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:04.961949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:04.962237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] PATH_INFO: `/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6/users/faeed52619d64556810f9ff0b0474b57/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:05.006389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8e8067bd424e27bc1175afe88fb5d6, user_id=faeed52619d64556810f9ff0b0474b57, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:05.014493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:05.073306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1131/2248] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:04 2022] PUT /identity/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6/users/faeed52619d64556810f9ff0b0474b57/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:05.077629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:05.096935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a07d-6084-4bd2-ba17-643f9927de92 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:05.275785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:05.276321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:05.276682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:05.277066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:05.277881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:05.279823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e24523-556b-44e7-bc3c-052a5f1743d8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:05.306825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1118/2249] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:05.308877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:05.340222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77bae2-1829-497b-a94f-57f665c64281 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:05.357531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:05.358230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:05.358615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:05.358892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] PATH_INFO: `/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6/users/faeed52619d64556810f9ff0b0474b57/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:05.361551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8e8067bd424e27bc1175afe88fb5d6, user_id=faeed52619d64556810f9ff0b0474b57, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:05.364317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:05.407383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb394b-17b3-486f-ab1a-14c80bd1afde None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:05.407661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb394b-17b3-486f-ab1a-14c80bd1afde None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:05.408107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb394b-17b3-486f-ab1a-14c80bd1afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:05.419847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1132/2250] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:05 2022] PUT /identity/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6/users/faeed52619d64556810f9ff0b0474b57/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:09:05.489412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6dfb394b-17b3-486f-ab1a-14c80bd1afde None None] MFA Rules not processed for user `faeed52619d64556810f9ff0b0474b57`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:05.493536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6dfb394b-17b3-486f-ab1a-14c80bd1afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:05.504919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:05.785420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1119/2251] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:09:05.801807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:05.803816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:05.953839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7d7f-3597-4ee2-909e-f6530c10498b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:05.994077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:05.994077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:05.994077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:05.994077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.006060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.006498 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.006779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.066688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] MFA Rules not processed for user `3210c71488674ffcbdb2f8651dd45a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:06.068351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:06.107180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.108899 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:06.122547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1133/2252] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:06.221255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1120/2253] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:06.225517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:06.227063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:06.330756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207a3b5-506c-43f7-8409-52a9fd352db6 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:06.337807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:06.338617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.338902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.339174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.340200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.343041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:06.350805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:06.396535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1134/2254] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:06.400632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:06.419838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd98b-f5c4-4e30-89dd-87507827a63b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:06.561043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:06.561994 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.564171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.564572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.565853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.570763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:06.644700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1121/2255] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:09:06 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:06.648635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:06.661454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220be46-e5d9-4e97-905f-1e9693dc6add admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:06.688092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:06.689048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.689858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.689858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.691153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.692792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:06.741315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1135/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:06.742517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:06.758974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a13f5-328a-4f3e-a8ae-532bd16cf644 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:06.774222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:06.775341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.775652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.775950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] PATH_INFO: `/v3/projects/14f92383bc9c490c8622dc6b7530c956/users/16200b3e3d44424498df58cbfd2453c1/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.812942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f92383bc9c490c8622dc6b7530c956, user_id=16200b3e3d44424498df58cbfd2453c1, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.816119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:06.834213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:06.839740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1122/2257] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:06 2022] PUT /identity/v3/projects/14f92383bc9c490c8622dc6b7530c956/users/16200b3e3d44424498df58cbfd2453c1/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:06.843840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:06.867281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c12d-c25a-41c8-970c-188865b78744 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:06.975179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:06.976184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:06.976930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:06.977421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:06.980504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:06.984788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:07.004005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1136/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:07.007859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:07.024612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330213ec-ab33-4631-b485-74ed5bfdeefe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:07.038807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:07.039753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:07.040260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:07.040541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] PATH_INFO: `/v3/projects/14f92383bc9c490c8622dc6b7530c956/users/16200b3e3d44424498df58cbfd2453c1/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:07.051803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f92383bc9c490c8622dc6b7530c956, user_id=16200b3e3d44424498df58cbfd2453c1, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:07.056816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:07.079715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1123/2259] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:07 2022] PUT /identity/v3/projects/14f92383bc9c490c8622dc6b7530c956/users/16200b3e3d44424498df58cbfd2453c1/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:08.071108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:08.073763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:08.231858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa1b4-3df4-41d4-883e-c3bfd56c7383 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:08.305087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:08.306095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:08.309591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:08.310040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:08.422751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:08.470973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:08.477228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:08.505019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1137/2260] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:09.783832 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:09.800572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9d25b-5ab3-4fcc-a1c4-a812dece6f60 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:09.804723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:09.805347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:09.805625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:09.805897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:09.912571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:09.915014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b115b4-b9e2-4428-b2e9-4962505b567c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:09.941485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1124/2261] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:14.898570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:15.080530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da36610-69f4-4b7b-98c3-5b91ef683890 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:15.086995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:15.087655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:15.088082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:15.088642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] PATH_INFO: `/v3/users/ed62709e30e64c23afd8ce090a818580` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:15.089830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed62709e30e64c23afd8ce090a818580)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:15.092328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:15.240033 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed62709e30e64c23afd8ce090a818580'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:15.262939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed62709e30e64c23afd8ce090a818580'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:15.301438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed62709e30e64c23afd8ce090a818580'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:15.302426 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed62709e30e64c23afd8ce090a818580'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:15.303066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed62709e30e64c23afd8ce090a818580'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:15.349593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1138/2262] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:09:14 2022] DELETE /identity/v3/users/ed62709e30e64c23afd8ce090a818580 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:15.353993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc6772-852b-4a6d-9f76-a212f97fe931 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:15.354581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc6772-852b-4a6d-9f76-a212f97fe931 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:15.354711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc6772-852b-4a6d-9f76-a212f97fe931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:15.429926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b3bc6772-852b-4a6d-9f76-a212f97fe931 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:15.432869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b3bc6772-852b-4a6d-9f76-a212f97fe931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:15.651980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1125/2263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:15.694167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:15.695688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:15.820382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866938-1eb9-4693-968f-014c7eb31697 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:15.827501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:15.828152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:15.828444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:15.828725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:15.862503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:15.864097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:15.879005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1139/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:16.154698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:16.155073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:16.155474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:16.219030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] MFA Rules not processed for user `16200b3e3d44424498df58cbfd2453c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:16.223839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:16.448924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1126/2265] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:16.518844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:16.521111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:16.533373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:16.680938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c471f-7bb6-4daf-8c85-9e158d17e250 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:16.690308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:16.691198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:16.691713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:16.692138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:16.694332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:16.724242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:16.726728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:16.748891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58aec-2f44-49a7-a186-1d6411e5dbda None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:16.755281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:16.756024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:16.756376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:16.756722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] PATH_INFO: `/v3/projects/726041ff1b0140929d38513f4959a118` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:16.758332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=726041ff1b0140929d38513f4959a118)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:16.760681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:16.767178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:16.841949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:16.843982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:16.866704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1140/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:16.897328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726041ff1b0140929d38513f4959a118', 'request_id': 'req-1025111d-5811-41ad-81ca-771f8c72d78c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:16.930924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726041ff1b0140929d38513f4959a118', 'request_id': 'req-1025111d-5811-41ad-81ca-771f8c72d78c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:16.963705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726041ff1b0140929d38513f4959a118', 'request_id': 'req-1025111d-5811-41ad-81ca-771f8c72d78c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.001679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] The token cache is being invalidate because project 726041ff1b0140929d38513f4959a118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:17.002363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.004378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1025111d-5811-41ad-81ca-771f8c72d78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.007686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1127/2267] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:16 2022] DELETE /identity/v3/projects/726041ff1b0140929d38513f4959a118 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:17.012662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:17.043590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0173a-5bcb-4241-8b97-5186065b1cc7 service glance] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:17.159587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:17.160423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:17.160805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:17.161198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] PATH_INFO: `/v3/users/728c140d3d0b4070bb64fe4d3ee1d93b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:17.162827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728c140d3d0b4070bb64fe4d3ee1d93b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:17.166404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:17.256645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728c140d3d0b4070bb64fe4d3ee1d93b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.291567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728c140d3d0b4070bb64fe4d3ee1d93b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.307315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:17.307938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:17.308438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:17.310172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:17.346244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728c140d3d0b4070bb64fe4d3ee1d93b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.348042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728c140d3d0b4070bb64fe4d3ee1d93b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.348762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3b535d97-0af6-44c2-93c4-8a5e05c32a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728c140d3d0b4070bb64fe4d3ee1d93b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:17.351806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:17.354006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:17.376540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1141/2268] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:09:17 2022] DELETE /identity/v3/users/728c140d3d0b4070bb64fe4d3ee1d93b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:17.381563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:17.381998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:17.382296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:17.405024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] MFA Rules not processed for user `11ad6f5f60af4f9ebc73aab606c8a15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:17.406256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:17.509065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1128/2269] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 15:09:17.514487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:17.520113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:17.570809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1142/2270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:17.638428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f577e-5078-4bf9-8076-993f5bb7ab64 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:17.689460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:17.725161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:17.725894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:17.726246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:17.726627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:17.807696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:17.810411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:17.820612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:17.822742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:17.842610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1129/2271] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:09:17.933209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa4fb2-d47c-409b-9616-439c934779a4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:17.947292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:17.948096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:17.948444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:17.948791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] PATH_INFO: `/v3/projects/83dcbf03295b458c9d60b3797fff16b3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:17.950655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dcbf03295b458c9d60b3797fff16b3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:17.952680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:18.078619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dcbf03295b458c9d60b3797fff16b3', 'request_id': 'req-b32949ff-c828-4f90-b9a4-e357f808f385'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.099713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dcbf03295b458c9d60b3797fff16b3', 'request_id': 'req-b32949ff-c828-4f90-b9a4-e357f808f385'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.119422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dcbf03295b458c9d60b3797fff16b3', 'request_id': 'req-b32949ff-c828-4f90-b9a4-e357f808f385'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.136194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] The token cache is being invalidate because project 83dcbf03295b458c9d60b3797fff16b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:18.136614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.138251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.149919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1143/2272] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:17 2022] DELETE /identity/v3/projects/83dcbf03295b458c9d60b3797fff16b3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:18.150043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:18.161239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c70f-184a-4e43-86b5-1eca4dbdd72e service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:18.388848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:18.390005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:18.390569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:18.391120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] PATH_INFO: `/v3/users/faeed52619d64556810f9ff0b0474b57` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:18.393118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faeed52619d64556810f9ff0b0474b57)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:18.395641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:18.506924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faeed52619d64556810f9ff0b0474b57'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.508158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faeed52619d64556810f9ff0b0474b57'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.520260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faeed52619d64556810f9ff0b0474b57'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.551610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faeed52619d64556810f9ff0b0474b57'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.552453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b3883faf-dcf4-4ebe-b4ec-7d6b53b2aeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faeed52619d64556810f9ff0b0474b57'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:18.567551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:18.579488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1130/2273] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:09:18 2022] DELETE /identity/v3/users/faeed52619d64556810f9ff0b0474b57 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:19.208594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:19.210089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:19.295458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32949ff-c828-4f90-b9a4-e357f808f385 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:19.337309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:19.478023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:19.479115 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:19.479646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:19.480143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] PATH_INFO: `/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:19.482220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8e8067bd424e27bc1175afe88fb5d6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:19.488344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:19.597882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8e8067bd424e27bc1175afe88fb5d6', 'request_id': 'req-c0477285-2fd3-4793-8556-638f0cc2b4fe'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:19.618669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8e8067bd424e27bc1175afe88fb5d6', 'request_id': 'req-c0477285-2fd3-4793-8556-638f0cc2b4fe'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:19.636058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8e8067bd424e27bc1175afe88fb5d6', 'request_id': 'req-c0477285-2fd3-4793-8556-638f0cc2b4fe'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:19.663955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] The token cache is being invalidate because project 6a8e8067bd424e27bc1175afe88fb5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:19.664289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:19.665989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:19.668402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1144/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:19 2022] DELETE /identity/v3/projects/6a8e8067bd424e27bc1175afe88fb5d6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:28.168522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a51e-0472-43dc-8133-9c85331588ad None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:28.169125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a51e-0472-43dc-8133-9c85331588ad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:28.169125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a51e-0472-43dc-8133-9c85331588ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:28.200189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5f11a51e-0472-43dc-8133-9c85331588ad None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:28.204176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f11a51e-0472-43dc-8133-9c85331588ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:28.307926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1131/2275] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:28.321422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:28.324746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:28.435176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477285-2fd3-4793-8556-638f0cc2b4fe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:28.442121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:28.442809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:28.443091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:28.443366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:28.455535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:28.457152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42df5-60df-41cb-8be6-6434a1e57f62 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:28.468344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1145/2276] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:09:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:09:31.570888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:31.571919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:31.572361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:31.594832 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:31.595923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:31.596738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:31.631478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:31.632626 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:31.638592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] MFA Rules not processed for user `3210c71488674ffcbdb2f8651dd45a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:31.640232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:31.644119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1132/2277] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:31.668177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:31.702925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b307b04-6de2-4125-b955-a819b5a9dc9d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:31.712997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:31.713846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:31.714294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:31.714776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:31.723332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:31.742477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:31.745171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:31.766327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1146/2278] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:09:31.776165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1133/2279] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:09:34.971878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:34.979326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:35.062017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5004-f3b8-46cd-9834-518b9976ee30 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:35.068123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:35.068787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.069132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.070788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] PATH_INFO: `/v3/users/b54e8fa8416f4d319aa2c7e6370c92ac` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.071423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54e8fa8416f4d319aa2c7e6370c92ac)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:35.073475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:35.141137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54e8fa8416f4d319aa2c7e6370c92ac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.153064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54e8fa8416f4d319aa2c7e6370c92ac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.174967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54e8fa8416f4d319aa2c7e6370c92ac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.174967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54e8fa8416f4d319aa2c7e6370c92ac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.175693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-323dd1eb-553f-4de9-90a6-e4b2b3a3e3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54e8fa8416f4d319aa2c7e6370c92ac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.194171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1147/2280] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:09:34 2022] DELETE /identity/v3/users/b54e8fa8416f4d319aa2c7e6370c92ac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:35.416991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:35.427906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8fcd-6484-4e55-a3c7-9707cf46156b service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:35.497429 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:35.498177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.498549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.498889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] PATH_INFO: `/v3/projects/4858441b2436456a8e5172b40b5738e4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.500097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4858441b2436456a8e5172b40b5738e4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:35.502094 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:35.557794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4858441b2436456a8e5172b40b5738e4', 'request_id': 'req-58d506c0-ba90-4e9e-ac3e-35211393be25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.565908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4858441b2436456a8e5172b40b5738e4', 'request_id': 'req-58d506c0-ba90-4e9e-ac3e-35211393be25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.576608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4858441b2436456a8e5172b40b5738e4', 'request_id': 'req-58d506c0-ba90-4e9e-ac3e-35211393be25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.590916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] The token cache is being invalidate because project 4858441b2436456a8e5172b40b5738e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:09:35.591224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.591977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-58d506c0-ba90-4e9e-ac3e-35211393be25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:09:35.593554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1134/2281] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:09:35 2022] DELETE /identity/v3/projects/4858441b2436456a8e5172b40b5738e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:35.598955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.598955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.599197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.625027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:35.626246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:35.681872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:35.691731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1148/2282] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:35.700816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.702102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.702790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.725983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:35.727270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:35.739448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1135/2283] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:35.743979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:35.760551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89d126-43da-48e4-956e-9264e360caf1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:35.766310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:35.766930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.767207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.767477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.768135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:09:35.768443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:35.770034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:35.790571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1149/2284] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:09:35.791657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:35.801297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955f1d-587b-4c9a-8e2a-79bef2133f93 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:35.807046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:35.807771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:35.808350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:35.808633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:35.809369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:35.811567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:35.816702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:35.882030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1136/2285] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:09:35 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:09:35.882916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:35.911442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225eee8-bb62-4a0e-84a5-4c11f78aec1c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:36.026082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:36.027505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.028089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.028442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.029154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:36.032816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:36.067581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1150/2286] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:09:35 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:09:36.071365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:36.091104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e4e0-a816-4e66-9bf7-c8b8df21ed49 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:36.096674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:36.097601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.098082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.098592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.099824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:36.101599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:36.114968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1137/2287] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:36.118583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:36.132487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce130af-e27e-4520-9293-c5356ebaea7b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:36.139697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:36.140432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.140915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.141746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.142058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:36.152467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582dbe3-76aa-4668-b2ea-1ecc02ed3cf5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:36.176301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1151/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:09:36.180870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:36.192727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121c88-2fc8-496d-b464-86f18dfc9b1e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:36.198988 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:36.200142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.200906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.201175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] PATH_INFO: `/v3/projects/832ded91fe7049d19d7712e12c8adcc9/users/ffa33e7783b84deea884d5a6c9e86b96/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.219151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832ded91fe7049d19d7712e12c8adcc9, user_id=ffa33e7783b84deea884d5a6c9e86b96, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:36.222216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:36.244027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1138/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:09:36 2022] PUT /identity/v3/projects/832ded91fe7049d19d7712e12c8adcc9/users/ffa33e7783b84deea884d5a6c9e86b96/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:09:36.254869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda818b-6d1b-4429-ae6b-bbf5ae4e1e7c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.255377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda818b-6d1b-4429-ae6b-bbf5ae4e1e7c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.255794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda818b-6d1b-4429-ae6b-bbf5ae4e1e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.285933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0dda818b-6d1b-4429-ae6b-bbf5ae4e1e7c None None] MFA Rules not processed for user `ffa33e7783b84deea884d5a6c9e86b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:36.287334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0dda818b-6d1b-4429-ae6b-bbf5ae4e1e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:36.406520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1152/2290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:36.416369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:36.419785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:36.563607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec5c-f35d-47a2-a849-83c0a2a57eb1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:36.567901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:36.569018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:36.569369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:36.569718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:36.585203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:36.587687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:36.622968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1139/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:37.240918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d88-7007-4ac9-a5ee-a4b97d52e9b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:37.241449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d88-7007-4ac9-a5ee-a4b97d52e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:37.241449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d88-7007-4ac9-a5ee-a4b97d52e9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:37.273785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-51db4d88-7007-4ac9-a5ee-a4b97d52e9b7 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:37.275127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-51db4d88-7007-4ac9-a5ee-a4b97d52e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:37.342447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:37.356936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1153/2292] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:37.391212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:37.392951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:37.567117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da76d7-d883-47e1-997f-83a88f75a345 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:37.578974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:37.579745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:37.580045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:37.580323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:37.601339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:37.606368 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccf4e0-904e-4bb2-900f-1e56b267e305 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:37.625933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1140/2293] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:09:47.357375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:47.617949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:09:53.620024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0464-6cdf-43cf-a25a-caff6108cca0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:53.621042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0464-6cdf-43cf-a25a-caff6108cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:53.621749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0464-6cdf-43cf-a25a-caff6108cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:53.652964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d01f0464-6cdf-43cf-a25a-caff6108cca0 None None] MFA Rules not processed for user `6bb8f9c24bbf460dab2bfb8ae539b374`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:53.654487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d01f0464-6cdf-43cf-a25a-caff6108cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:53.721607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1154/2294] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:09:54.843672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020950-3733-4411-841e-bbd235cbc6a2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:54.844209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020950-3733-4411-841e-bbd235cbc6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:54.844456 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020950-3733-4411-841e-bbd235cbc6a2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:54.846245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1141/2295] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:09:54.853886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b193f1-5891-4f18-9d1d-c5c29c3f2e4f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:54.854391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b193f1-5891-4f18-9d1d-c5c29c3f2e4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:54.854569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b193f1-5891-4f18-9d1d-c5c29c3f2e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:54.881190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-76b193f1-5891-4f18-9d1d-c5c29c3f2e4f None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:54.882712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-76b193f1-5891-4f18-9d1d-c5c29c3f2e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:54.995017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1155/2296] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:55.011995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020950-3733-4411-841e-bbd235cbc6a2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:55.036428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020950-3733-4411-841e-bbd235cbc6a2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:55.043941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:55.044575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.044839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.045115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.057104 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:55.058758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47b8a-083a-45a4-82dd-4803e0346d18 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:55.074468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1142/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:55.168205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.168616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.168953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.170483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1156/2298] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:09:55.175336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82bf5-982a-43c2-ae18-835aeb342465 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.175718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82bf5-982a-43c2-ae18-835aeb342465 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.176209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82bf5-982a-43c2-ae18-835aeb342465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.198661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-22d82bf5-982a-43c2-ae18-835aeb342465 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:55.200076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-22d82bf5-982a-43c2-ae18-835aeb342465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:55.252380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1143/2299] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:09:55.265530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:55.267287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:55.281390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f9c0-7d3b-44a1-bb76-1406d3218d89 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:55.284933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:55.285524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.285808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.286082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.294587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:55.296078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d90a-d373-4f46-8b55-6d92cd8b55b8 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:55.303975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1157/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:55.387387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698b-3ecb-414c-ba36-f1bc5487735a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.387675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698b-3ecb-414c-ba36-f1bc5487735a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.387949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698b-3ecb-414c-ba36-f1bc5487735a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.389305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1144/2301] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:09:55.394551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad34d-0cb9-4f34-bd52-f28b7fbe4f53 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.394842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad34d-0cb9-4f34-bd52-f28b7fbe4f53 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.395119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad34d-0cb9-4f34-bd52-f28b7fbe4f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.416118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-868ad34d-0cb9-4f34-bd52-f28b7fbe4f53 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:55.417327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-868ad34d-0cb9-4f34-bd52-f28b7fbe4f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:55.426573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1158/2302] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:55.436979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382698b-3ecb-414c-ba36-f1bc5487735a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:55.447918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382698b-3ecb-414c-ba36-f1bc5487735a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:55.452477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:55.453071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:55.453353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:55.453628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:55.465813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:55.467278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:55.478347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1145/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:09:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:09:58.834450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:58.835349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:58.835629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:58.859496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:09:58.863199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:09:58.873331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1159/2304] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:09:58.886531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:09:58.898250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da814ca-4925-4af6-b188-a3031c84c62b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:09:58.904694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:09:58.905345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:09:58.905631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:09:58.905878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:09:58.914898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:09:58.916889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8e8fb-b3ea-4882-8355-4623e2526494 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:09:58.926126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1146/2305] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:10:04.856717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:04.921019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed840-d909-44e2-995b-b8f6131dd4e3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:04.925543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:04.926175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:04.926494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:04.926766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] PATH_INFO: `/v3/users/ffa33e7783b84deea884d5a6c9e86b96` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:04.927924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa33e7783b84deea884d5a6c9e86b96)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:04.930329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:04.945065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:04.992896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa33e7783b84deea884d5a6c9e86b96'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.000815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa33e7783b84deea884d5a6c9e86b96'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.017498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa33e7783b84deea884d5a6c9e86b96'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.018558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa33e7783b84deea884d5a6c9e86b96'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.019185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa33e7783b84deea884d5a6c9e86b96'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.034545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1160/2306] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:10:04 2022] DELETE /identity/v3/users/ffa33e7783b84deea884d5a6c9e86b96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:05.039341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:05.040073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:05.040073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:05.061595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:05.063049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:05.154690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1147/2307] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:05.162029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:05.163497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:05.272516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562f81-3fb3-467f-bfa3-0ea3d8e0aace admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:05.279593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:05.280222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:05.280503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:05.280775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:05.302535 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:05.304336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321b751-064d-4559-8eb8-36dfa9368fa6 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:05.315994 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1161/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:05.709073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:05.710774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:05.747892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63ef7-9ebe-4eea-81ad-203f3bba505e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:05.755630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:05.756932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:05.757376 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:05.757741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] PATH_INFO: `/v3/projects/832ded91fe7049d19d7712e12c8adcc9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:05.759472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=832ded91fe7049d19d7712e12c8adcc9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:05.761703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:05.851761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832ded91fe7049d19d7712e12c8adcc9', 'request_id': 'req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.860935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832ded91fe7049d19d7712e12c8adcc9', 'request_id': 'req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.867460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832ded91fe7049d19d7712e12c8adcc9', 'request_id': 'req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.868703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:05.884485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] The token cache is being invalidate because project 832ded91fe7049d19d7712e12c8adcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:10:05.884777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.885989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de55405-b91f-4369-9aba-4b3f4bb0b8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:05.890997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1148/2309] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:10:05 2022] DELETE /identity/v3/projects/832ded91fe7049d19d7712e12c8adcc9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:05.892691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:05.893168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:05.893383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:05.913985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:05.915513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:06.000144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1162/2310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:06.007916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.008200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.008477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.030312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:06.031667 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:06.039661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1149/2311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:06.044501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.053954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8671b20-97a0-4002-a3e0-51bada21bd17 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.060862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.060862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.060862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.060862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.061279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:10:06.061279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.062601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.075097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1163/2312] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:10:06.079473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.089863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa8a44-d30a-42ba-bf23-3041c2aa4644 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.094625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.095232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.095508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.095775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.096435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.098343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.131002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1150/2313] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:10:06 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:10:06.132227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.143596 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a781e7-28b1-4e85-8c14-d6704d15a617 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.164872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:06.208701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.210530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.210927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.211261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.211955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.214486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.242688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1164/2314] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:10:06 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:10:06.244039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.254755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f335-cca4-4e61-bc26-2a25c42a1d58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.259339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.260188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.260499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.261034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.261783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.263405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.290063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1151/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:10:06.294850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.305913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a767b0-c56b-4054-a3d8-92c7620cb548 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.311472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.312095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.312384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.312688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.313352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.315079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b727-75f4-4723-8da1-8920a0062f94 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.327177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1165/2316] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:10:06.331488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.343331 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef2168-6401-4485-bcc1-12be1a969850 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.354900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.355678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.356179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.356532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] PATH_INFO: `/v3/projects/2fd43fc75018402c9d8dd5dcabddf00e/users/bbf176363fb24add96263cf4e9229f7e/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.373224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd43fc75018402c9d8dd5dcabddf00e, user_id=bbf176363fb24add96263cf4e9229f7e, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.376160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.394324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1152/2317] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:10:06 2022] PUT /identity/v3/projects/2fd43fc75018402c9d8dd5dcabddf00e/users/bbf176363fb24add96263cf4e9229f7e/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:10:06.406498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f974-0c8f-4c6b-985a-039f690244eb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.406871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f974-0c8f-4c6b-985a-039f690244eb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.407212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f974-0c8f-4c6b-985a-039f690244eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.439608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8064f974-0c8f-4c6b-985a-039f690244eb None None] MFA Rules not processed for user `bbf176363fb24add96263cf4e9229f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:06.440931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8064f974-0c8f-4c6b-985a-039f690244eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:06.544754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1166/2318] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:06.560155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:06.563262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:06.634246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3e70-c51a-40e5-a48b-f875b653d5c6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:06.638519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:06.639241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:06.639634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:06.639798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:06.655487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:06.655487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:06.662006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1153/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:16.016922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:16.017437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:16.017528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:16.036869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:16.038078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:16.101289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1167/2320] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:10:16.124377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:16.125786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:16.199923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782a50-cd29-43dc-ad0e-b617915001de service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:16.206621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:16.207230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:16.207508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:16.207779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:16.216101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:16.217653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:16.225648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1154/2321] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:10:19.372602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:19.374020 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:19.406593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:19.430126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e0ded-af8d-4681-8e02-74fdf530cbf6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:19.434250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:19.434869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:19.435141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:19.435405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:19.437084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:19.497360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:19.498820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:19.508036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1168/2322] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:26.222489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:29.503980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=35 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:29.818684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:29.820126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:29.888958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf17f-2077-4295-b0d0-22ba02a4da45 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:29.894117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:29.894754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:29.895037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:29.895310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:29.897013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:29.909663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:29.911262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab69ec-3629-4760-ae77-342fe47cc180 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:29.920921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1155/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:30.664755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:30.725063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19812-9007-44de-a101-1a2205aceb90 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:30.729557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:30.730815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:30.731112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:30.731383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] PATH_INFO: `/v3/users/bbf176363fb24add96263cf4e9229f7e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:30.732487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf176363fb24add96263cf4e9229f7e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:30.734438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:30.778073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf176363fb24add96263cf4e9229f7e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:30.784904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf176363fb24add96263cf4e9229f7e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:30.797045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf176363fb24add96263cf4e9229f7e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:30.797710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf176363fb24add96263cf4e9229f7e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:30.798373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf176363fb24add96263cf4e9229f7e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:30.811436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1169/2324] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:10:30 2022] DELETE /identity/v3/users/bbf176363fb24add96263cf4e9229f7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:30.815898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:30.816190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:30.816471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:30.835021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:30.836211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:30.893034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1156/2325] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:10:30.902925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:30.904298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:30.959674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7823-d389-42fd-8f0d-3e7731e4eeb1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:30.963252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:30.963846 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:30.964120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:30.964385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:30.973629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:30.975077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c305672-5d37-4937-a0b7-d57172089e3a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:30.985929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1170/2326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:31.241372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.242848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:31.255755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f336e-03a7-47c6-ab59-2ec42b1e8a14 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.260350 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.260983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.261262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.262058 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] PATH_INFO: `/v3/projects/2fd43fc75018402c9d8dd5dcabddf00e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.263207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd43fc75018402c9d8dd5dcabddf00e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.265112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.311547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd43fc75018402c9d8dd5dcabddf00e', 'request_id': 'req-72e615eb-db95-441e-a687-3b2eda3b7cb3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:31.318616 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd43fc75018402c9d8dd5dcabddf00e', 'request_id': 'req-72e615eb-db95-441e-a687-3b2eda3b7cb3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:31.324698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd43fc75018402c9d8dd5dcabddf00e', 'request_id': 'req-72e615eb-db95-441e-a687-3b2eda3b7cb3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:31.335692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] The token cache is being invalidate because project 2fd43fc75018402c9d8dd5dcabddf00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:10:31.335980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:31.336609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-72e615eb-db95-441e-a687-3b2eda3b7cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:31.338075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1157/2327] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:10:31 2022] DELETE /identity/v3/projects/2fd43fc75018402c9d8dd5dcabddf00e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:31.344037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.344320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.344591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.363707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:31.364884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:31.381483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:31.425918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1171/2328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:31.434250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.434568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.434840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.454821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:31.456023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:31.463844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1158/2329] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:31.467894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.477409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec99c-d55f-4b98-bc4e-e48d22f78bdd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.482030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.482652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.482924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.483195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.483825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:10:31.484120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.485777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.497770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1172/2330] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:10:31.501828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.510972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a2ec6-9d94-4d74-8fd6-6903b0f431c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.516099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.516680 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.516955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.517226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.517878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.519820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.524234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:31.548696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1159/2331] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:10:31 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:10:31.552717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.563266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999612f6-8f73-4b15-93a1-f93e577ef17d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.619380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.619987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.620267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.620537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.621673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.623603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.645942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1173/2332] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:10:31 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:10:31.650287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.663395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32943bc-1369-4840-9d70-1d675fc85722 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.668295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.668898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.669175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.669443 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.670107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.672041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.683071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1160/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:10:31.687551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.698320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad350-2c1b-49ff-b7c6-52749dc5edd3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.703597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.704198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.704473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.704745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.705569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.707195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaba9a-d265-4d2b-88a8-8c49776fdffd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.718569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1174/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:10:31.722785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.732800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2335d4-789c-4a06-8668-03ce4e5fe0f8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.737421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.738065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.738387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.738663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] PATH_INFO: `/v3/projects/a3738455c70f48c28ceca2b7d4e70733/users/0edea9d371524528827b3c63226d12ae/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.753471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3738455c70f48c28ceca2b7d4e70733, user_id=0edea9d371524528827b3c63226d12ae, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.756166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:31.769912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1161/2335] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:10:31 2022] PUT /identity/v3/projects/a3738455c70f48c28ceca2b7d4e70733/users/0edea9d371524528827b3c63226d12ae/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:31.780985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.781283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.781541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.810290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] MFA Rules not processed for user `0edea9d371524528827b3c63226d12ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:31.811494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:31.876780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1175/2336] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:31.888773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:31.895422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:31.966917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a948-c0cc-4b18-a196-c7e8153553d9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:31.970655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:31.971271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:31.971552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:31.971930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:31.989973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:31.991451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062636da-6236-44a6-9408-c022d84ae47a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:32.001240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1162/2337] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:41.873418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:41.996894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:42.013259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:42.077840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0a16-a237-4831-a9bb-b3798e792148 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:42.085144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:42.085769 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:42.086047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:42.086349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] PATH_INFO: `/v3/users/0edea9d371524528827b3c63226d12ae` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:42.087467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edea9d371524528827b3c63226d12ae)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:42.089450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:42.137249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edea9d371524528827b3c63226d12ae'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.144164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edea9d371524528827b3c63226d12ae'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.160498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edea9d371524528827b3c63226d12ae'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.162679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edea9d371524528827b3c63226d12ae'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.163313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edea9d371524528827b3c63226d12ae'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.177526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1176/2338] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:10:42 2022] DELETE /identity/v3/users/0edea9d371524528827b3c63226d12ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:42.182012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:42.182327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:42.182601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:42.208237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:10:42.210038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:42.269781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1163/2339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:10:42.279320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:42.280730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:42.341264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927f6e-45c4-46e9-bfef-518b6799ded9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:42.346386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:42.347069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:42.348674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:42.348674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:42.360238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:42.361898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846e8a-843f-4868-9094-7e84e91dc8a9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:42.372690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1177/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:10:42.859973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:10:42.861422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:10:42.873325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c494-8c53-4a8b-8c44-e613fe81a2f7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:10:42.878139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:10:42.878835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:10:42.879118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:10:42.879394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] PATH_INFO: `/v3/projects/a3738455c70f48c28ceca2b7d4e70733` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:10:42.880524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3738455c70f48c28ceca2b7d4e70733)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:10:42.882470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:10:42.934999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3738455c70f48c28ceca2b7d4e70733', 'request_id': 'req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.942337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3738455c70f48c28ceca2b7d4e70733', 'request_id': 'req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.948095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3738455c70f48c28ceca2b7d4e70733', 'request_id': 'req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.959402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] The token cache is being invalidate because project a3738455c70f48c28ceca2b7d4e70733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:10:42.959692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.960339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b09a869-6f6f-47df-aa5d-9dc6f7fac3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:10:42.962082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1164/2341] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:10:42 2022] DELETE /identity/v3/projects/a3738455c70f48c28ceca2b7d4e70733 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:10:52.367396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:10:52.956366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:11:07.698206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b75d-65c3-4383-b1f3-c73ec963a85e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:11:07.698826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b75d-65c3-4383-b1f3-c73ec963a85e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:11:07.698826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b75d-65c3-4383-b1f3-c73ec963a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:11:07.733082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-43f6b75d-65c3-4383-b1f3-c73ec963a85e None None] MFA Rules not processed for user `11ad6f5f60af4f9ebc73aab606c8a15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:11:07.734320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-43f6b75d-65c3-4383-b1f3-c73ec963a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:11:07.822922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1178/2342] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:11:10.949703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e24-9435-4961-8784-18e36f32909c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:11:10.950260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e24-9435-4961-8784-18e36f32909c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:11:10.950381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e24-9435-4961-8784-18e36f32909c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:11:10.970918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-faac6e24-9435-4961-8784-18e36f32909c None None] MFA Rules not processed for user `9bf031090a79480291873a34ce703e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:11:10.972143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-faac6e24-9435-4961-8784-18e36f32909c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:11:11.031649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1165/2343] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:11:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:11:17.814118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:11:19.374077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc5a7-d16d-4416-a598-6527c5e2623e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:11:19.374676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc5a7-d16d-4416-a598-6527c5e2623e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:11:19.374676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc5a7-d16d-4416-a598-6527c5e2623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:11:19.392969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b4dc5a7-d16d-4416-a598-6527c5e2623e None None] MFA Rules not processed for user `6bb8f9c24bbf460dab2bfb8ae539b374`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:11:19.394152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b4dc5a7-d16d-4416-a598-6527c5e2623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:11:19.448451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1179/2344] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:11:21.023894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:11:29.441773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:11:48.810868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:11:48.811447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:11:48.811981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:11:48.834643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] MFA Rules not processed for user `0ebfb0c90f2e4b219012916ad2f9b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:11:48.835852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:11:48.890189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1166/2345] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:11:58.882894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:04.927380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee72-61ef-4d3f-b701-7d1b9897fda6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:04.927847 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee72-61ef-4d3f-b701-7d1b9897fda6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:04.927952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee72-61ef-4d3f-b701-7d1b9897fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:04.947748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8999ee72-61ef-4d3f-b701-7d1b9897fda6 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:04.948929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8999ee72-61ef-4d3f-b701-7d1b9897fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:05.003768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1180/2346] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:12:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:05.049843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:05.051255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:05.118589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7b39e-6261-412d-a17f-bef9c6ea5fad None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:05.123418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:05.124072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:05.124348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:05.124614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:05.138550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:05.140208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09203d-f157-4b4f-bbc6-47237a5360b6 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:05.148435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1167/2347] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:12:12.142018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:12.142981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:12.143462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:12.144971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1181/2348] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 15:12:12.158697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:12.159538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:12.160006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:12.189881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] MFA Rules not processed for user `c7b33447fc1e41e1bf083519b827cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:12.191243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:12.267737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:12.269529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:12.273692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1168/2349] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:12.289266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:12.305571 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:12.337604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1af99-65c0-4a55-af49-0c358364f7d1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:12.343812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:12.344428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:12.344707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:12.344981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:12.358296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:12.360688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:12.369179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314469ae-b51c-42d4-a89b-911227a90b2a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:12.374691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1169/2350] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:12.378826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:12.379565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:12.379843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:12.380117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] PATH_INFO: `/v3/users/3210c71488674ffcbdb2f8651dd45a90` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:12.381383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3210c71488674ffcbdb2f8651dd45a90)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:12.385296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:12.444059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3210c71488674ffcbdb2f8651dd45a90'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.454189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3210c71488674ffcbdb2f8651dd45a90'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.469342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3210c71488674ffcbdb2f8651dd45a90'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.470087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3210c71488674ffcbdb2f8651dd45a90'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.470747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3210c71488674ffcbdb2f8651dd45a90'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.491783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1182/2351] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:12 2022] DELETE /identity/v3/users/3210c71488674ffcbdb2f8651dd45a90 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:12.814214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:12.827878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafbe4-66fa-4ad7-abd9-9cf7b89fced3 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:12.898244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:12.899356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:12.899702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:12.900057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] PATH_INFO: `/v3/projects/8f58d481a435486cbb4e81c2a1d4aee8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:12.901270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f58d481a435486cbb4e81c2a1d4aee8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:12.903304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:12.921357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:12.956369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f58d481a435486cbb4e81c2a1d4aee8', 'request_id': 'req-287c547b-3ea9-4f75-8d38-01da22d3ba8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.964661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f58d481a435486cbb4e81c2a1d4aee8', 'request_id': 'req-287c547b-3ea9-4f75-8d38-01da22d3ba8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.975214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f58d481a435486cbb4e81c2a1d4aee8', 'request_id': 'req-287c547b-3ea9-4f75-8d38-01da22d3ba8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.991086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] The token cache is being invalidate because project 8f58d481a435486cbb4e81c2a1d4aee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:12.991392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.992091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:12.996961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1170/2352] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:12 2022] DELETE /identity/v3/projects/8f58d481a435486cbb4e81c2a1d4aee8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:12.997946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:13.003507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:13.028689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c092f7-0776-484e-aefe-1458eb08c692 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:13.061262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:13.122843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:13.123558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:13.123845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:13.124108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] PATH_INFO: `/v3/users/16200b3e3d44424498df58cbfd2453c1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:13.125389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16200b3e3d44424498df58cbfd2453c1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:13.127402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:13.184500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16200b3e3d44424498df58cbfd2453c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.196117 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16200b3e3d44424498df58cbfd2453c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.209643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16200b3e3d44424498df58cbfd2453c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.210468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16200b3e3d44424498df58cbfd2453c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.211075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16200b3e3d44424498df58cbfd2453c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.226286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1183/2353] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:12 2022] DELETE /identity/v3/users/16200b3e3d44424498df58cbfd2453c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:13.401883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:13.403502 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:13.417761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c547b-3ea9-4f75-8d38-01da22d3ba8d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:13.482899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:13.483535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:13.483810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:13.484075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] PATH_INFO: `/v3/projects/14f92383bc9c490c8622dc6b7530c956` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:13.485215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f92383bc9c490c8622dc6b7530c956)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:13.487213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:13.546531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f92383bc9c490c8622dc6b7530c956', 'request_id': 'req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.555977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f92383bc9c490c8622dc6b7530c956', 'request_id': 'req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.563335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f92383bc9c490c8622dc6b7530c956', 'request_id': 'req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.584144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] The token cache is being invalidate because project 14f92383bc9c490c8622dc6b7530c956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:13.584433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.585283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:13.587494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1171/2354] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:13 2022] DELETE /identity/v3/projects/14f92383bc9c490c8622dc6b7530c956 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:17.011327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.013533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.047499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.049059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.083169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dbb27-be52-4108-b98d-ec4b4535dfc2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.102837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:17.138305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fad1-ad7b-42a7-89f3-7e977cd08fcb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.142846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.143027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.143478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.143619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.143764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.143904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.144019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] PATH_INFO: `/v3/users/11ad6f5f60af4f9ebc73aab606c8a15f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.144274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.145177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ad6f5f60af4f9ebc73aab606c8a15f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.146089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.147145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.159929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:17.198846 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ad6f5f60af4f9ebc73aab606c8a15f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.199534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ad6f5f60af4f9ebc73aab606c8a15f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.207234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ad6f5f60af4f9ebc73aab606c8a15f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.219536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ad6f5f60af4f9ebc73aab606c8a15f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.220183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ad6f5f60af4f9ebc73aab606c8a15f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.226695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.228240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.233275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1172/2355] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:17 2022] DELETE /identity/v3/users/11ad6f5f60af4f9ebc73aab606c8a15f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:17.240382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1184/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:17.243393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.244791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.302889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784284-8bca-4231-87cd-bd26036da266 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.307273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.307986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.308391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.308790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.310696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.377833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.379295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef6e75-5d4f-408b-981b-1f1cdf7a2513 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.389635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1173/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:17.567342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.578981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62d45-0900-4814-876b-0e15940da61a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.584326 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.585169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.585458 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.585724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] PATH_INFO: `/v3/projects/809d97a61e7540ab90585eaf42835ba6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.586894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809d97a61e7540ab90585eaf42835ba6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.588797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.644160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809d97a61e7540ab90585eaf42835ba6', 'request_id': 'req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.653333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809d97a61e7540ab90585eaf42835ba6', 'request_id': 'req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.660936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809d97a61e7540ab90585eaf42835ba6', 'request_id': 'req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.672807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] The token cache is being invalidate because project 809d97a61e7540ab90585eaf42835ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:17.673196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.674095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dd0ec0-4ad0-4453-ad78-1c51e1d84472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:17.675678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1185/2358] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:17 2022] DELETE /identity/v3/projects/809d97a61e7540ab90585eaf42835ba6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:17.681069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.681441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.682233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.690830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:17.705847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:17.707356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.773792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1174/2359] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:17.782403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.782690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.782965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.803944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:17.805087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:17.812991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1186/2360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:17.817139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.826765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a142b-89aa-46eb-b118-aba5904d3747 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.831313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.831901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.832177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.832449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.833087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:17.833390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.835024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.846863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1175/2361] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:12:17.850970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.860685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990e44-1442-4f7f-968d-bbd46e07918a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.865337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.865932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.866210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.866534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.867159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.869067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:17.897373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1187/2362] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:17 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:17.902610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:17.914980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee065a2-1dd5-42bf-a2db-4badbd082597 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:17.975184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:17.975795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:17.976064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:17.976339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:17.976974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:17.979268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.001046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1176/2363] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:17 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:18.005173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:18.015403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3cccb-3c2d-4899-aa1c-29364fffe72c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:18.020391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:18.020995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.021270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.021539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.022179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:18.023802 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.034158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1188/2364] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:18.037839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:18.048216 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765040-4660-439e-bfe3-e29db97e68e1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:18.053049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:18.053638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.054231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.054483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.055112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:18.056682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4737f-8877-48cd-800f-f843a3db52c2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.068359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1177/2365] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:12:18.072335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:18.082646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9476e8-465d-4e17-b34a-5141e69bd417 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:18.087271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:18.087928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.088202 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.088474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] PATH_INFO: `/v3/projects/8c580c2be1c648639fd0e208299a7e19/users/762207f5cd0f420c849c7c1ed9617310/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.104109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c580c2be1c648639fd0e208299a7e19, user_id=762207f5cd0f420c849c7c1ed9617310, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:18.106812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.121189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1189/2366] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:18 2022] PUT /identity/v3/projects/8c580c2be1c648639fd0e208299a7e19/users/762207f5cd0f420c849c7c1ed9617310/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:18.131356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.131759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.132029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.161382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] MFA Rules not processed for user `762207f5cd0f420c849c7c1ed9617310`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:18.162637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:18.236836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:18.242966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1178/2367] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:18.256376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:18.258421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:18.283666 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:18.346277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8cb2a-8a87-4ca9-854d-cf9b68a50e92 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:18.351788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:18.352390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.352664 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.352933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.360670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:18.362239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.370808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1190/2368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:18.721688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:18.723281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:18.785159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3eb9d-ad37-44d3-b763-c7529562f0b7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:18.788810 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:18.789415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:18.789690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:18.789964 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:18.791685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:18.805229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:18.806691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285a212-d369-4324-bdc8-84ef955fbfa3 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:18.817877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1179/2369] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:23.611650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:23.674505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c909-f1da-4965-8f7e-5c427b69baa2 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:23.679645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:23.680490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:23.680617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:23.680808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] PATH_INFO: `/v3/users/762207f5cd0f420c849c7c1ed9617310` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:23.681934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762207f5cd0f420c849c7c1ed9617310)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:23.684051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:23.742888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762207f5cd0f420c849c7c1ed9617310'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:23.751902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762207f5cd0f420c849c7c1ed9617310'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:23.771798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762207f5cd0f420c849c7c1ed9617310'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:23.772665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762207f5cd0f420c849c7c1ed9617310'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:23.773310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762207f5cd0f420c849c7c1ed9617310'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:23.790178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1191/2370] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:23 2022] DELETE /identity/v3/users/762207f5cd0f420c849c7c1ed9617310 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:23.795556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:23.796031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:23.796310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:23.819133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:23.820584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:23.898355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1180/2371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:23.909641 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:23.911266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:23.947638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:23.987801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c09d2-0ad0-4aca-9b9a-6b0d825d8fa9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:23.991563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:23.992185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:23.992466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:23.992739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:24.002662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:24.005612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638355-7955-4eb7-8854-be77fe8cf6ef service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:24.017904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1192/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:24.780445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:24.781955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:24.794130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4936-0866-4511-8fa8-2841604b5d54 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:24.805078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:24.805711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:24.805981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:24.806245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] PATH_INFO: `/v3/projects/8c580c2be1c648639fd0e208299a7e19` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:24.807584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c580c2be1c648639fd0e208299a7e19)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:24.809478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:24.861061 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c580c2be1c648639fd0e208299a7e19', 'request_id': 'req-d97dba46-ffbd-4dc2-986e-e83e35c1b486'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:24.868494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c580c2be1c648639fd0e208299a7e19', 'request_id': 'req-d97dba46-ffbd-4dc2-986e-e83e35c1b486'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:24.875105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c580c2be1c648639fd0e208299a7e19', 'request_id': 'req-d97dba46-ffbd-4dc2-986e-e83e35c1b486'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:24.886700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] The token cache is being invalidate because project 8c580c2be1c648639fd0e208299a7e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:24.887069 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:24.887815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d97dba46-ffbd-4dc2-986e-e83e35c1b486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:24.890005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1181/2373] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:24 2022] DELETE /identity/v3/projects/8c580c2be1c648639fd0e208299a7e19 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:24.894936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:24.895405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:24.895517 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:24.920380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:24.921616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:24.991428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1193/2374] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:25.000757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.001042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.001315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.020701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:25.021979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:25.029825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1182/2375] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:25.034162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.047282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a03b56-91c7-43be-b615-8db00ab40722 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.052098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.052797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.053146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.053491 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.054497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:25.054872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.056557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.069687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1194/2376] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:12:25.074118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.083393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357adf-767b-4f87-8376-346f57a6bfae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.088084 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.088675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.088953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.089217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.089947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.091874 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.108482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:25.122237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1183/2377] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:25 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:25.126973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.136918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af925-3f2c-4796-84ef-c202d7d6d3b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.212120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.212742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.213016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.213289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.216201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.218405 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.258999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1195/2378] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:25 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:25.260504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.282039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc497-cc7d-47b1-acc0-d7c5a2b7633f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.288341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.289086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.289424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.289784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.290538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.292203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.310310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1184/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:12:25.311637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.322716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab36af7-3289-4f23-8dcd-0890bdccec03 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.328974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.329599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.329907 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.330152 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.330964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.332621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c8a13-5520-4ae4-a3ca-a0b64c8af0e2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.347815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1196/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:25.349698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.362242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d4f7-e289-4db4-8d12-3569c2d11899 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.367258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.367914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.368211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.368743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] PATH_INFO: `/v3/projects/902f9a002a8f439dbac5bf46207d6d0b/users/fa82d17739824e18b31f82aded905e29/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.384321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902f9a002a8f439dbac5bf46207d6d0b, user_id=fa82d17739824e18b31f82aded905e29, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.387032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.401050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1185/2381] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:25 2022] PUT /identity/v3/projects/902f9a002a8f439dbac5bf46207d6d0b/users/fa82d17739824e18b31f82aded905e29/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:25.412555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.412727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.413065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.443457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] MFA Rules not processed for user `fa82d17739824e18b31f82aded905e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:25.444820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:25.469562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:25.516825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1197/2382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:25.521332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.590650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175737e8-24b4-4f0c-aac0-9b1c544920c7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.597742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.598453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.598806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.599057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.599721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.601652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.632797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1186/2383] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:25 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:25.634080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.645331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798bc1-b2de-40d3-9a8a-f5745dc2d103 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.709417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.710038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.711358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.711358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.712188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.714198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.738659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1198/2384] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:25 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:25.742115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.752698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66765a0-0f37-47a8-996c-1ceb299a84d7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.757507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.758346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.758686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.759047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.759767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.761495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.773295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1187/2385] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:25.777486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.791422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2410-ab2e-4714-a61f-08966ac14406 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.798554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.799396 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.799719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.800025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] PATH_INFO: `/v3/projects/ff1d133f0e3e432eb6845d8895a310cc/users/0ec285a0d70e408899ad6ebe54bf3f49/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.827271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d133f0e3e432eb6845d8895a310cc, user_id=0ec285a0d70e408899ad6ebe54bf3f49, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.829941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.852109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1199/2386] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:25 2022] PUT /identity/v3/projects/ff1d133f0e3e432eb6845d8895a310cc/users/0ec285a0d70e408899ad6ebe54bf3f49/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:25.856220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.868524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830593-55ef-4b5e-b33d-65027b19a0eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.944283 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.944897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.945182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.945477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.946086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.947715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbdabe-a590-496e-aef5-f7ebbe0b8d5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:25.958574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1188/2387] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:25.962764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:25.978602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491625-edc4-4796-849a-504c8c088688 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:25.983834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:25.984901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:25.985251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:25.986915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] PATH_INFO: `/v3/projects/ff1d133f0e3e432eb6845d8895a310cc/users/0ec285a0d70e408899ad6ebe54bf3f49/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:25.988946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d133f0e3e432eb6845d8895a310cc, user_id=0ec285a0d70e408899ad6ebe54bf3f49, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:25.991731 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:26.002840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1200/2388] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:25 2022] PUT /identity/v3/projects/ff1d133f0e3e432eb6845d8895a310cc/users/0ec285a0d70e408899ad6ebe54bf3f49/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:26.013965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20d2c-48ba-4d62-8400-8c54f2773b82 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:26.014365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20d2c-48ba-4d62-8400-8c54f2773b82 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:26.014653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20d2c-48ba-4d62-8400-8c54f2773b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:26.044865 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-54d20d2c-48ba-4d62-8400-8c54f2773b82 None None] MFA Rules not processed for user `0ec285a0d70e408899ad6ebe54bf3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:26.045730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-54d20d2c-48ba-4d62-8400-8c54f2773b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:26.065735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:26.120117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1189/2389] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:26.131871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:26.133600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:26.192246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3800-1640-4c0b-a1a8-589b8cf891ce admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:26.195949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:26.196549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:26.196820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:26.197085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:26.207400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:26.209021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:26.219264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1201/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:26.282930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:26.283214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:26.283489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:26.306698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] MFA Rules not processed for user `6bb8f9c24bbf460dab2bfb8ae539b374`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:26.306698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:26.314887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:26.323493 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0330-cdcc-41d1-861d-d5ca51f7f0cb service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:26.327910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:26.328500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:26.328782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:26.329052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:26.342035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:26.363129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1190/2391] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:26.388966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:26.390416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd516a2-b4e6-4e0d-a640-adf8ab93f652 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:26.400371 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1202/2392] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:29.145573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:29.223142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e2e0-b065-41df-9b51-c75eb212417f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:29.229121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:29.229843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:29.230190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:29.230573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] PATH_INFO: `/v3/users/fa82d17739824e18b31f82aded905e29` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:29.231793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa82d17739824e18b31f82aded905e29)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:29.235232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:29.300147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa82d17739824e18b31f82aded905e29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.300827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa82d17739824e18b31f82aded905e29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.314086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa82d17739824e18b31f82aded905e29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.331621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:29.337769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa82d17739824e18b31f82aded905e29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.339576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa82d17739824e18b31f82aded905e29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.361883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1191/2393] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:29 2022] DELETE /identity/v3/users/fa82d17739824e18b31f82aded905e29 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:29.363636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:29.364169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:29.364169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:29.386001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:29.387457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:29.462077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1203/2394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:29.487932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:29.490303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:29.583252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8952a-9f09-4efd-9741-bfdb36ec7556 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:29.586859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:29.587470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:29.587786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:29.588056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:29.599212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:29.600664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:29.611585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1192/2395] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:29.887803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:29.889586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:29.903631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81acb3c-3f51-475a-beac-104b7823e6d9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:29.908369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:29.909077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:29.909418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:29.909827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] PATH_INFO: `/v3/projects/902f9a002a8f439dbac5bf46207d6d0b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:29.911086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] RBAC: Authorizing `identity:delete_project(project_id=902f9a002a8f439dbac5bf46207d6d0b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:29.913548 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:29.964424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902f9a002a8f439dbac5bf46207d6d0b', 'request_id': 'req-261f81da-a025-4a1a-84bf-6c5a8e3cafda'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.973197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902f9a002a8f439dbac5bf46207d6d0b', 'request_id': 'req-261f81da-a025-4a1a-84bf-6c5a8e3cafda'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.983698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902f9a002a8f439dbac5bf46207d6d0b', 'request_id': 'req-261f81da-a025-4a1a-84bf-6c5a8e3cafda'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.994501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] The token cache is being invalidate because project 902f9a002a8f439dbac5bf46207d6d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:29.994792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.995447 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:29.996932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1204/2396] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:29 2022] DELETE /identity/v3/projects/902f9a002a8f439dbac5bf46207d6d0b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:30.001530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.011078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71232496-15e1-4e6d-9ba5-14779b9d6699 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.069046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.069685 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.069958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.070227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] PATH_INFO: `/v3/users/0ec285a0d70e408899ad6ebe54bf3f49` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.071446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec285a0d70e408899ad6ebe54bf3f49)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.073344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.120198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec285a0d70e408899ad6ebe54bf3f49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.120928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec285a0d70e408899ad6ebe54bf3f49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.128789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec285a0d70e408899ad6ebe54bf3f49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.140931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec285a0d70e408899ad6ebe54bf3f49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.141606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-429eabb3-e33c-4f7e-84b8-62d43faae292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec285a0d70e408899ad6ebe54bf3f49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.155597 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1193/2397] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:30 2022] DELETE /identity/v3/users/0ec285a0d70e408899ad6ebe54bf3f49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:30.437232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.438720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:30.452305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f81da-a025-4a1a-84bf-6c5a8e3cafda admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.499076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:30.520182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.520818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.521092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.521363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] PATH_INFO: `/v3/projects/ff1d133f0e3e432eb6845d8895a310cc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.522880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1d133f0e3e432eb6845d8895a310cc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.524797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.573890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1d133f0e3e432eb6845d8895a310cc', 'request_id': 'req-edb05771-4789-4ef1-a7ff-6316c653cd1c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.583892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1d133f0e3e432eb6845d8895a310cc', 'request_id': 'req-edb05771-4789-4ef1-a7ff-6316c653cd1c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.590800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1d133f0e3e432eb6845d8895a310cc', 'request_id': 'req-edb05771-4789-4ef1-a7ff-6316c653cd1c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.603110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] The token cache is being invalidate because project ff1d133f0e3e432eb6845d8895a310cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:30.603499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.604251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-edb05771-4789-4ef1-a7ff-6316c653cd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:30.605787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1205/2398] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:30 2022] DELETE /identity/v3/projects/ff1d133f0e3e432eb6845d8895a310cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:30.610751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.610969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.611246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.619217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:30.633877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:30.635152 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:30.695072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1194/2399] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:30.703380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.703632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.703902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.724104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:30.725365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:30.733817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1206/2400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:30.737981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.747780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007ae7d-73f2-45a8-a287-de9eca010bf7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.752326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.752919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.753199 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.753472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.754111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:30.754446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.756033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.767916 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1195/2401] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:12:30.772140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.781999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f57b6-696a-4203-886c-1c3c19b93a95 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.786530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.787116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.787389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.787675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.788268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.790139 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.817474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1207/2402] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:30 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:30.821570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.832059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808dafa-a877-459d-aecc-0f301aa1ffb9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.888804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.889401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.889674 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.889942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.890609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.892508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.913954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1196/2403] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:30 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:30.918295 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.929030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9313a6-a538-4b2d-b130-69a483f94279 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.933588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.934182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.934489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.934757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.935920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.937534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.947514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1208/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:30.952066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:30.962116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba65f3-0b46-42e9-aaf5-cadf824bc73e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:30.967509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:30.968116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:30.968402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:30.968679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:30.969324 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:30.970958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149b01-b603-4fd8-9d67-92942a2e647a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:30.984230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1197/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:31.002550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.012659 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde141e-6062-48dc-9e37-88cc5a4c2973 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.018204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.018885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.019862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.020167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] PATH_INFO: `/v3/projects/b97d18c96b634c9e8db781b4478ea5b1/users/81c0d443a6c041fc92896980dbb9b7a3/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.035268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97d18c96b634c9e8db781b4478ea5b1, user_id=81c0d443a6c041fc92896980dbb9b7a3, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.037976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.051702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1209/2406] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:30 2022] PUT /identity/v3/projects/b97d18c96b634c9e8db781b4478ea5b1/users/81c0d443a6c041fc92896980dbb9b7a3/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:31.062940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.063230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.063504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.094712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] MFA Rules not processed for user `81c0d443a6c041fc92896980dbb9b7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:31.095946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:31.156928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:31.162788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1198/2407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:31.168143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.231069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b2bf-e6c0-466d-bcb8-37c31fde99b0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.235778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.236381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.236644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.236916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.237556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.239482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.251095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:31.269627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1210/2408] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:31 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:31.273486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.284201 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461eafd-c182-457a-bb43-dc20760dc148 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.342359 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.342965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.343261 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.343530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.344148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.346070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.373408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1199/2409] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:31 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:31.377236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.388034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5e70-2ad2-4ec4-902a-3c93ce7ba562 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.393362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.393995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.394292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.394582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.395212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.396806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.410410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1211/2410] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:31.410582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.410582 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:31.411302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.421973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f7c5-4e27-476b-bbd8-352e5abd963e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.426774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.427418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.427700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.427974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] PATH_INFO: `/v3/projects/aa577cfe930248cfbac352848c318264/users/cc9877c3a050448ba22f5152fc147ec7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.443583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa577cfe930248cfbac352848c318264, user_id=cc9877c3a050448ba22f5152fc147ec7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.446391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.461284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1212/2411] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:31 2022] PUT /identity/v3/projects/aa577cfe930248cfbac352848c318264/users/cc9877c3a050448ba22f5152fc147ec7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:31.466501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.472741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41cfbf-f9b8-4619-9b0a-4d31d47d57e7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.524025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.524747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.525027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.525297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.526882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2d16-0e30-464b-8641-a51d192f6129 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.527083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:31.531740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.532343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.532620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.532889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.533592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.535254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.545952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1213/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:31.550435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.561444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa62ce-8af3-4dc2-a127-0e8fc0a991d0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.566029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.566683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.566956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.567228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] PATH_INFO: `/v3/projects/aa577cfe930248cfbac352848c318264/users/cc9877c3a050448ba22f5152fc147ec7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.569109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa577cfe930248cfbac352848c318264, user_id=cc9877c3a050448ba22f5152fc147ec7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.571788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a35aa-30b1-4d60-9bc9-d72d1d69a571 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.581777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1214/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:31 2022] PUT /identity/v3/projects/aa577cfe930248cfbac352848c318264/users/cc9877c3a050448ba22f5152fc147ec7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:31.593484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.593617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390223-af5f-4a43-9c04-ae3244f52a03 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.593793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390223-af5f-4a43-9c04-ae3244f52a03 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.594122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390223-af5f-4a43-9c04-ae3244f52a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.595240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.599661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:31.609337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1200/2414] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:31.631368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-10390223-af5f-4a43-9c04-ae3244f52a03 None None] MFA Rules not processed for user `cc9877c3a050448ba22f5152fc147ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:31.632646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10390223-af5f-4a43-9c04-ae3244f52a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:31.715216 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1215/2415] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:31.727080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:31.728609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:31.800478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4134a5f-d72f-45eb-8f96-b5f48785f000 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:31.854958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:31.855573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:31.855850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:31.860235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:31.930889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:31.933903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:31.958778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1201/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:32.015951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:32.016336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:32.016606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:32.038109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:32.039546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:32.060002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:32.106703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1216/2417] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:12:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:32.127759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:32.129222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:32.238854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fc6f-8c9e-4918-a05a-160d69d97432 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:32.248903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:32.250703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:32.251215 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:32.251464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:32.277175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:32.280292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:32.283965 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:32.291049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1202/2418] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:12:33.427302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:33.429032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:33.442865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b1577-84a2-463c-8970-b966b1eb4083 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:33.446423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:33.447026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:33.447299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:33.447564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:33.458004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:33.459497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c37c9-2f46-46be-a733-8bf93d501dd2 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:33.469438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1217/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:37.455248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:37.532708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c676-07b6-4538-bbb5-26798ac819aa service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:37.537230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:37.537902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:37.538183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:37.538485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] PATH_INFO: `/v3/users/81c0d443a6c041fc92896980dbb9b7a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:37.539615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c0d443a6c041fc92896980dbb9b7a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:37.541725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:37.607459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c0d443a6c041fc92896980dbb9b7a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:37.608267 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c0d443a6c041fc92896980dbb9b7a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:37.618236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c0d443a6c041fc92896980dbb9b7a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:37.633844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c0d443a6c041fc92896980dbb9b7a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:37.635002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c0d443a6c041fc92896980dbb9b7a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:37.649875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1203/2420] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:37 2022] DELETE /identity/v3/users/81c0d443a6c041fc92896980dbb9b7a3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:37.655801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:37.655801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:37.655801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:37.675130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:37.676410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:37.759771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1218/2421] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:37.771036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:37.772549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:37.851553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496e0f-7917-4fca-b8dc-be5978001f33 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:37.855980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:37.856947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:37.857317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:37.857661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:37.870677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:37.872912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:37.887455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1204/2422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:38.428575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:38.430068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:38.444394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01f141-c8a0-44b9-a9e6-67876ffa4b53 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:38.449394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:38.449962 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:38.451003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:38.451375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] PATH_INFO: `/v3/projects/b97d18c96b634c9e8db781b4478ea5b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:38.453370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97d18c96b634c9e8db781b4478ea5b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:38.454876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:38.534357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97d18c96b634c9e8db781b4478ea5b1', 'request_id': 'req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.544882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97d18c96b634c9e8db781b4478ea5b1', 'request_id': 'req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.554455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97d18c96b634c9e8db781b4478ea5b1', 'request_id': 'req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.577920 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] The token cache is being invalidate because project b97d18c96b634c9e8db781b4478ea5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:38.578346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.579228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.580825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1219/2423] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:38 2022] DELETE /identity/v3/projects/b97d18c96b634c9e8db781b4478ea5b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:38.585126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:38.600873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daadd-54b4-43ef-a8f3-057c940c218b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:38.622625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:38.688409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:38.689308 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:38.689648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:38.690608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] PATH_INFO: `/v3/users/cc9877c3a050448ba22f5152fc147ec7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:38.691611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9877c3a050448ba22f5152fc147ec7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:38.693599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:38.726230 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:38.730141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:38.776356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9877c3a050448ba22f5152fc147ec7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.776864 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9877c3a050448ba22f5152fc147ec7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.787149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9877c3a050448ba22f5152fc147ec7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.804279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9877c3a050448ba22f5152fc147ec7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.806808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9877c3a050448ba22f5152fc147ec7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:38.818723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:38.845489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1205/2424] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:38 2022] DELETE /identity/v3/users/cc9877c3a050448ba22f5152fc147ec7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:38.879392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2e57-3be5-4a5a-81ba-a7bebc471fe1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:38.980809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:38.982644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:38.986243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:38.986726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:38.989942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:39.079198 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:39.081760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161adb16-597c-4e3f-9574-28e1079a6ba6 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:39.110498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1220/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:39.256191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:39.257722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:39.415184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d740-b38c-4e95-aad7-3b986a68d66d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:39.429703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:39.433980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:39.434485 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:39.435306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] PATH_INFO: `/v3/projects/aa577cfe930248cfbac352848c318264` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:39.438663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa577cfe930248cfbac352848c318264)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:39.446578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:39.574772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:39.595116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa577cfe930248cfbac352848c318264', 'request_id': 'req-fa9af2f8-851c-4431-9568-ccdd9aa74a80'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:39.613637 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa577cfe930248cfbac352848c318264', 'request_id': 'req-fa9af2f8-851c-4431-9568-ccdd9aa74a80'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:39.623467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa577cfe930248cfbac352848c318264', 'request_id': 'req-fa9af2f8-851c-4431-9568-ccdd9aa74a80'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:39.637581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] The token cache is being invalidate because project aa577cfe930248cfbac352848c318264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:39.637581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:39.638789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fa9af2f8-851c-4431-9568-ccdd9aa74a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:39.644318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1206/2426] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:39 2022] DELETE /identity/v3/projects/aa577cfe930248cfbac352848c318264 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:39.646036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:39.646540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:39.646947 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:39.673366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:39.674671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:39.769132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1221/2427] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:39.777121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:39.777449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:39.777749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:39.810393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:39.811703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:39.829112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1207/2428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:39.833630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:39.856171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f56d-8fc0-451c-816f-46d9e3ae108d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:39.865324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:39.865944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:39.866239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:39.866533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:39.867518 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:39.867942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:39.869632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:39.889656 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:39.895540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1222/2429] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:12:39.900924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55b15b-efe4-46b5-b047-8944ee24fc37 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:39.908759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:39.909632 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:39.910022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:39.910562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:39.911398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:39.913600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:39.948568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1208/2430] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:39.953273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:39.959025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:39.966526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a366-3339-4a90-beb0-0fdc7e302a0e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.063687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.064454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.064835 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.065226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.065957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.069101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.105689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1223/2431] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:39 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:40.110405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.122716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88f15-8d06-4bae-9bf9-33319d8025ed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.129679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.130503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.130855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.131211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.131918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.134164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.151401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.159828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1209/2432] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:40.164479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5164-cfb4-4a29-af61-aa532ca5ea9b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.170772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.171483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.171756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.172200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.172869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.174985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f404-a64f-4a0b-a255-9d3652be003f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.194576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1224/2433] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:40.195946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.215440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed15b8-ae47-48fa-bbaa-99240f050c5c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.223841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.224657 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.225016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.225374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] PATH_INFO: `/v3/projects/191894d1582247f6b830e74be557cc16/users/c5cc615a56364c6594fe80347ac026f1/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.247260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191894d1582247f6b830e74be557cc16, user_id=c5cc615a56364c6594fe80347ac026f1, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.250698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.286050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1210/2434] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:40 2022] PUT /identity/v3/projects/191894d1582247f6b830e74be557cc16/users/c5cc615a56364c6594fe80347ac026f1/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:40.287365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.287937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.288418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.327330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] MFA Rules not processed for user `c5cc615a56364c6594fe80347ac026f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:40.328895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:40.430126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1225/2435] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:40.435712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.558310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172069d-c723-4c6a-9c8e-527260ba0b37 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.573885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.574602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.574931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.576420 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.576944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.581145 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.675634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1211/2436] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:40 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:40.679620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.697095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb44b6-e997-4ae7-bfb2-b3586c947d09 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.816417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.817671 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.818145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.818615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.819443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.827586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.850470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:40.858306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1226/2437] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:40 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:40.861820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.873587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6037ca-d8a5-4bdc-8971-1763420886ac admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.897307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.898309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.898309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.898629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.899335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.901011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:40.915848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1212/2438] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:40.917070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:40.931704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2bbc-1fb0-4def-bcb3-6bbf5fe01617 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:40.941079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:40.941757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:40.942035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:40.942331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] PATH_INFO: `/v3/projects/7a7563eed12a48f98eff752098738169/users/62e1417d4943434cb3a5a9c35732a1f3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:40.966512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7563eed12a48f98eff752098738169, user_id=62e1417d4943434cb3a5a9c35732a1f3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:40.969179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:41.013785 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1227/2439] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:40 2022] PUT /identity/v3/projects/7a7563eed12a48f98eff752098738169/users/62e1417d4943434cb3a5a9c35732a1f3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:41.017878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:41.045774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38dd4-e8e4-4f93-bd46-7c7858746d95 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:41.106966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:41.163137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:41.163780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:41.164056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:41.164340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:41.165002 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:41.166647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346c610-cdf3-4994-83db-8c2372430fee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:41.186673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1213/2440] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:41.187130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:41.200041 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb237-8af1-4593-82d8-7dcb8dd64c75 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:41.208207 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:41.208890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:41.209170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:41.209437 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] PATH_INFO: `/v3/projects/7a7563eed12a48f98eff752098738169/users/62e1417d4943434cb3a5a9c35732a1f3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:41.211892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7563eed12a48f98eff752098738169, user_id=62e1417d4943434cb3a5a9c35732a1f3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:41.215001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:41.234660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1228/2441] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:41 2022] PUT /identity/v3/projects/7a7563eed12a48f98eff752098738169/users/62e1417d4943434cb3a5a9c35732a1f3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:41.246693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:41.247603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:41.247979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:41.289361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] MFA Rules not processed for user `62e1417d4943434cb3a5a9c35732a1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:41.291466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:41.389700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1214/2442] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:41.396976 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:41.398837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:41.502149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf0ce-ebb8-49ad-8cdc-74b87e9c2dc0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:41.508459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:41.508459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:41.508459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:41.508459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:41.520096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:41.522107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4f7e1-373d-4bc1-ad30-77a9b2229dc5 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:41.534315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1229/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:42.247484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:42.317059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d68a4-8f60-4e14-980c-1c8ca3414e31 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:42.321786 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:42.322459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:42.322745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:42.323014 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] PATH_INFO: `/v3/users/c5cc615a56364c6594fe80347ac026f1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:42.324158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cc615a56364c6594fe80347ac026f1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:42.326116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:42.414719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cc615a56364c6594fe80347ac026f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:42.414719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cc615a56364c6594fe80347ac026f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:42.419483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cc615a56364c6594fe80347ac026f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:42.425446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:42.435905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cc615a56364c6594fe80347ac026f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:42.436636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cc615a56364c6594fe80347ac026f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:42.459625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1215/2444] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:42 2022] DELETE /identity/v3/users/c5cc615a56364c6594fe80347ac026f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:42.464186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:42.464667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:42.464853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:42.487753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:42.489072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:42.569007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1230/2445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:42.579639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:42.581367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:42.658437 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5723-cb1a-458d-a5c7-a3c9a95be196 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:42.662133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:42.662827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:42.663106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:42.663375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:42.673893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:42.675386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:42.687039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1216/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:43.026480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:43.027921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:43.041532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed1ed-652b-4b90-9c67-6a39acd7ce72 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:43.061153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:43.062013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:43.062165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:43.062640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] PATH_INFO: `/v3/projects/191894d1582247f6b830e74be557cc16` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:43.064613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191894d1582247f6b830e74be557cc16)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:43.066538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:43.130450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191894d1582247f6b830e74be557cc16', 'request_id': 'req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.142233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191894d1582247f6b830e74be557cc16', 'request_id': 'req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.152313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191894d1582247f6b830e74be557cc16', 'request_id': 'req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.153833 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:43.175248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] The token cache is being invalidate because project 191894d1582247f6b830e74be557cc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:43.175554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.176285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.178836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1231/2447] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:43 2022] DELETE /identity/v3/projects/191894d1582247f6b830e74be557cc16 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:43.182736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:43.196924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b76f-3809-4772-9e31-d640cb535dec service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:43.271369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:43.272761 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:43.273209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:43.273776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] PATH_INFO: `/v3/users/62e1417d4943434cb3a5a9c35732a1f3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:43.275172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e1417d4943434cb3a5a9c35732a1f3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:43.277237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:43.362080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e1417d4943434cb3a5a9c35732a1f3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.362815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e1417d4943434cb3a5a9c35732a1f3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.373836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e1417d4943434cb3a5a9c35732a1f3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.386607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e1417d4943434cb3a5a9c35732a1f3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.387690 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a892dda6-3189-481b-af23-be8cf5910759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e1417d4943434cb3a5a9c35732a1f3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.401496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1217/2448] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:43 2022] DELETE /identity/v3/users/62e1417d4943434cb3a5a9c35732a1f3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:43.740814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:43.742987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:43.759830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0dca9-49a1-4b7b-8f47-a93a4a915793 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:43.828908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:43.829590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:43.829870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:43.830140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] PATH_INFO: `/v3/projects/7a7563eed12a48f98eff752098738169` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:43.832584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7563eed12a48f98eff752098738169)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:43.833357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:43.884521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7563eed12a48f98eff752098738169', 'request_id': 'req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.892591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7563eed12a48f98eff752098738169', 'request_id': 'req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.911810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7563eed12a48f98eff752098738169', 'request_id': 'req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.915581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] The token cache is being invalidate because project 7a7563eed12a48f98eff752098738169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:43.915946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.916622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e6cc0f73-09b8-4789-a69a-6a0cfbb09355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:43.918162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1232/2449] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:43 2022] DELETE /identity/v3/projects/7a7563eed12a48f98eff752098738169 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:43.924089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:43.924461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:43.926247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:43.934504 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:43.950377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:43.952066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.020681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1218/2450] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:44.029465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.029755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.030030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.050609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:44.051854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.060150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1233/2451] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:44.064477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.073926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4e6f-e641-448f-83fb-10f6d02a1236 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.079025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.079617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.079895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.080167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.080830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:44.081154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.082847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.095011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1219/2452] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:12:44.099201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.108452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b360-4736-417e-84c9-fc43d191e085 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.113331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.113928 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.114204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.114506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.115140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.117028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.146679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1234/2453] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:12:44.150873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.161638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce743b9-39ae-461b-ac20-f360c2e7bdcc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.221172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.221902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.222207 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.222531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.223265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.225188 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.245564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1220/2454] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:44 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:44.249854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.263281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b3c41-182e-4c80-8ee1-f3aaef4ffa83 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.268390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.269086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.269450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.269794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.270631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.272352 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.273463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.275943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.284196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1235/2455] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:44.287961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.298179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36973dd7-55aa-4810-9147-3aa2feb7c940 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.302845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.303430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.303966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.304241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.304873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.306475 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.318066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1236/2456] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:44.321685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.331362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150975c3-f96a-4591-a1d4-f41d9b721feb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.336177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.336820 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.336940 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e002-ef32-447e-89f8-bf813ec376c6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.337100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.337376 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] PATH_INFO: `/v3/projects/c63a7209a29a4f3bb52053181920ea64/users/a75fc4f8b810433caaf2d2dc45e17584/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.340677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.341282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.341562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.341837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.344663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.356960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.357397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63a7209a29a4f3bb52053181920ea64, user_id=a75fc4f8b810433caaf2d2dc45e17584, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.359766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01092c-375f-4e66-b23b-f8c7f6a0fcb8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.360271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.367352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1221/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:44.376263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1237/2458] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:44 2022] PUT /identity/v3/projects/c63a7209a29a4f3bb52053181920ea64/users/a75fc4f8b810433caaf2d2dc45e17584/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:12:44.386533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.386942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.387225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.419537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] MFA Rules not processed for user `a75fc4f8b810433caaf2d2dc45e17584`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:44.420772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.431122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:44.500757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1222/2459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:44.512174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:44.514002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:44.520916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:44.577164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9d37-263e-4613-bb56-21fb079b275f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:44.580904 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:44.581516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:44.581795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:44.582065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:44.591148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:44.592594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a7536-aa86-4d07-9394-2581df7e57a0 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:44.601765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1238/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:47.175795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:47.241837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf290b6-5cee-4c82-b84f-745af405b898 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:47.246367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:47.247510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.247860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.248133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] PATH_INFO: `/v3/users/a75fc4f8b810433caaf2d2dc45e17584` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.249245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75fc4f8b810433caaf2d2dc45e17584)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:47.251180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:47.298753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75fc4f8b810433caaf2d2dc45e17584'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.299405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75fc4f8b810433caaf2d2dc45e17584'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.306499 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75fc4f8b810433caaf2d2dc45e17584'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.320009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75fc4f8b810433caaf2d2dc45e17584'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.320806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75fc4f8b810433caaf2d2dc45e17584'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.335328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1223/2461] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:12:47 2022] DELETE /identity/v3/users/a75fc4f8b810433caaf2d2dc45e17584 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:47.340099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.340744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.340744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.360355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:47.361715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:47.422413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1239/2462] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:47.432377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:47.433775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:47.471759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:47.500382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb93658-8883-47d6-8e5f-0235a1aed9fa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:47.504113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:47.504762 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.505049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.505317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.514465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:47.515883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add95be3-add2-4571-a38e-b3c9c7495b68 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:47.525401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1224/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:47.811709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:47.812956 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:47.831716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a00d-242d-4a68-8e9a-0f546d154d2e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:47.838800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:47.839504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.839781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.840051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] PATH_INFO: `/v3/projects/c63a7209a29a4f3bb52053181920ea64` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.842094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63a7209a29a4f3bb52053181920ea64)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:47.844413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:47.855137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07fac-f9d7-44e1-9221-2bbdc27cdde3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.855536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07fac-f9d7-44e1-9221-2bbdc27cdde3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.855885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07fac-f9d7-44e1-9221-2bbdc27cdde3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.858914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1225/2464] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:12:47.878776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.879160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.879520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.904023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:47.905240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:47.905355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63a7209a29a4f3bb52053181920ea64', 'request_id': 'req-ed84313a-5304-4da4-b679-87b1a97404a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.913739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63a7209a29a4f3bb52053181920ea64', 'request_id': 'req-ed84313a-5304-4da4-b679-87b1a97404a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.921231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63a7209a29a4f3bb52053181920ea64', 'request_id': 'req-ed84313a-5304-4da4-b679-87b1a97404a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.933874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] The token cache is being invalidate because project c63a7209a29a4f3bb52053181920ea64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:12:47.934171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.934931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed84313a-5304-4da4-b679-87b1a97404a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:12:47.936713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1240/2465] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:12:47 2022] DELETE /identity/v3/projects/c63a7209a29a4f3bb52053181920ea64 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:47.941473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef86b-f2f7-46af-9928-f5d2dc0fa2b9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:47.941759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef86b-f2f7-46af-9928-f5d2dc0fa2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:47.942031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef86b-f2f7-46af-9928-f5d2dc0fa2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:47.964545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3e6ef86b-f2f7-46af-9928-f5d2dc0fa2b9 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:47.966334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e6ef86b-f2f7-46af-9928-f5d2dc0fa2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:47.995097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1226/2466] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:47.999373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:48.009364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.011946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.040283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1241/2467] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:48.049756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.050049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.050355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.069857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:48.071094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.071613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af167ab9-37f4-4db6-96a0-17411a2e7cb3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.075227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dab615c85bb4e50b46a69e92b33963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.075958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.076315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.076655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.079148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1242/2468] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:48.083370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.087372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.088812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.092807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd57a-ce72-401c-ac0a-36ce3813a10c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.097441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.098019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.098322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.098599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.099233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:12:48.099566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.100070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1227/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:48.101305 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.114300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1243/2470] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:12:48.117742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.128358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f247d9-502e-46e8-84bd-303de4dbf619 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.133562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.134166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.134505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.134766 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.135396 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.137296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5af0-8955-42b3-9e56-6f0cf41e337d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.165658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1228/2471] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:48.170640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.175936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09008-9533-4735-be2c-8600a3a97da6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.176427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09008-9533-4735-be2c-8600a3a97da6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.176699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09008-9533-4735-be2c-8600a3a97da6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.178140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1229/2472] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:12:48.182118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cf52-c7aa-4edf-a633-909864c060ac admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.183000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.183495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.184136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.212411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] MFA Rules not processed for user `05c3fd3f0f2c4c48a9ced12e4ef9f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:48.214100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.246091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.246861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.247144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.247412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.248037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.250435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.266090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:48.282114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1244/2473] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:12:48.283981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1230/2474] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:48.287750 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.299066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.300655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.300843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44dff-1330-4d60-9c34-c82171504f2a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.306169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.307685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.307969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.308302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.309038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.310837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.315418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fb28-adc6-489b-8266-c30759646629 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.320683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.321309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.321599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.321872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.322497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1245/2475] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:12:48.327193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.330672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.332313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.337276 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71688-6b81-4cd2-960c-05526a8f6dd4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.341791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1231/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:48.344940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.345403 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.345572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.345818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.346501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.348243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f3022-132c-4261-867c-66f8ee9ea4ce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.359542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1246/2477] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:12:48.363704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.375290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519716-b268-44ac-b5f2-13ade3978384 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.379945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.380604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.380884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.381156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] PATH_INFO: `/v3/projects/03febcd4ac7249c1aa8871cfaf8fcc5b/users/625ae3b2732f4d7ab4dc1badf9881beb/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.400003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03febcd4ac7249c1aa8871cfaf8fcc5b, user_id=625ae3b2732f4d7ab4dc1badf9881beb, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.402929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe799f-04fd-4be3-9d9a-1f179c0f4567 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.418540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1232/2478] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:12:48 2022] PUT /identity/v3/projects/03febcd4ac7249c1aa8871cfaf8fcc5b/users/625ae3b2732f4d7ab4dc1badf9881beb/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:12:48.423388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.423680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.423957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.428920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25813d9-a457-4a56-ad7d-b3e1d9541903 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.429219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25813d9-a457-4a56-ad7d-b3e1d9541903 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.429484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25813d9-a457-4a56-ad7d-b3e1d9541903 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.430853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1233/2479] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 15:12:48.436033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.436377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.436662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.444968 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:48.446187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.458208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] MFA Rules not processed for user `456e7e3006f14407ac65e432ace7286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:48.459432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.509419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1247/2480] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:48.516349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.532778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1234/2481] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:48.542924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.545970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:48.586760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e52d9-3953-4ad5-b4d7-5a1a3feff6c0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.591096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.591800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.592261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.592424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.602528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcda14-f2e4-43c9-b773-4cfa4bdc26fc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.604105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.605554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.606393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.607151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.607277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.607519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.616400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1248/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:48.617914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.619365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc1f94-ca30-4c15-9d26-a407239c38e5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.631233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1235/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:48.712670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:48.714078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.785982 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8184-542e-4fa5-8d1b-e0f8af5d2963 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:48.791332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:48.791943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:48.792225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:48.792498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:48.794254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:48.807435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:48.809044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:48.821915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1249/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:49.456409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd80cc-ff70-45a5-8809-40102b634026 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:49.457337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd80cc-ff70-45a5-8809-40102b634026 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:49.457767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd80cc-ff70-45a5-8809-40102b634026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:49.498536 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fecd80cc-ff70-45a5-8809-40102b634026 None None] MFA Rules not processed for user `625ae3b2732f4d7ab4dc1badf9881beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:49.499876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fecd80cc-ff70-45a5-8809-40102b634026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:49.550767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:49.574709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1236/2485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:49.585520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:49.586938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:49.651286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157136e9-477f-44af-9126-1e15f6e67914 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:49.655397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:49.655995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:49.656267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:49.656558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:49.664841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:49.666259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbb679-6a5e-42d7-9231-8006ef3df117 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:49.675538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1250/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:12:51.085325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:51.085847 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:51.085975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:51.108633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] MFA Rules not processed for user `625ae3b2732f4d7ab4dc1badf9881beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:51.109751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:51.116746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1237/2487] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:12:51.275492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:51.275979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:51.276063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:51.295382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:12:51.296567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:51.347394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:12:51.355442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:51.355652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1251/2488] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:12:51.365310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e515-8181-45ed-8ba5-1c84d62c2971 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:51.367607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:12:51.368932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:51.369071 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:51.369617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:51.369899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:51.370172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:51.371885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:12:51.381424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:51.382893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:51.391333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1238/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:12:51.438746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b2fea-b849-4af1-826c-632bc04998b3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:12:51.443735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:12:51.444342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:12:51.444616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:12:51.444884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:12:51.454165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:12:51.455813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:12:51.464429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1252/2490] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 15:13:01.387242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=17 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:01.460540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=32 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:04.106035 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:04.107604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:04.135118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c237-c19f-4fda-ac71-cabb2effc651 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:04.143845 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:04.145068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:04.145346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:04.145621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:04.147494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:04.173097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:04.174961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e6c7-1aa6-4a69-b37b-f1183c0be638 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:04.219165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1239/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:04.773068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:04.792727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c555fe-2877-4aca-af3d-cc5b47aaa72e service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:04.805651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:04.806430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:04.806788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:04.807123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:04.812039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:04.835972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:04.839519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:04.897635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1253/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:07.014050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:07.014556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:07.014646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:07.033772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:07.035280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:07.042481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1240/2493] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:07.065048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:07.076796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb154f-bbae-4693-a2bf-45759ff6011e service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:07.082300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:07.082905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:07.083182 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:07.083451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:07.092187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:07.093775 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:07.101730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1254/2494] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:13:10.258425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:10.259932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:10.271344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6162e-da56-4ad4-a92d-853f7689d718 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:10.274923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:10.275517 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:10.275792 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:10.276060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:10.278351 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:10.290549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:10.292103 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:10.304749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1241/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:13.572336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:13.573923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:13.592595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705542-e770-4177-9e33-1b3eb0433a98 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:13.598193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:13.599057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:13.599439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:13.599988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] PATH_INFO: `/v3/users/0ebfb0c90f2e4b219012916ad2f9b071` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:13.601446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebfb0c90f2e4b219012916ad2f9b071)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:13.603709 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:13.654678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebfb0c90f2e4b219012916ad2f9b071'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:13.661760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebfb0c90f2e4b219012916ad2f9b071'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:13.674618 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebfb0c90f2e4b219012916ad2f9b071'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:13.675268 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebfb0c90f2e4b219012916ad2f9b071'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:13.675869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5df918b0-37c6-46df-b3a8-2ac1a02cd030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebfb0c90f2e4b219012916ad2f9b071'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:13.688945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1255/2496] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:13 2022] DELETE /identity/v3/users/0ebfb0c90f2e4b219012916ad2f9b071 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:13.867984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:13.878063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aeebfb-7a61-4eed-9a47-032e69db1225 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:13.942374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:13.942923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:13.943205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:13.943481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] PATH_INFO: `/v3/projects/c973f25451bc4792905503cbd1b6f974` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:13.944609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c973f25451bc4792905503cbd1b6f974)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:13.946552 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:13.995365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c973f25451bc4792905503cbd1b6f974', 'request_id': 'req-fb431126-1da6-445f-a287-875ec8bd785a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:14.002570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c973f25451bc4792905503cbd1b6f974', 'request_id': 'req-fb431126-1da6-445f-a287-875ec8bd785a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:14.008064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c973f25451bc4792905503cbd1b6f974', 'request_id': 'req-fb431126-1da6-445f-a287-875ec8bd785a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:14.020068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] The token cache is being invalidate because project c973f25451bc4792905503cbd1b6f974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:14.020356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:14.021247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb431126-1da6-445f-a287-875ec8bd785a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:14.023034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1242/2497] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:13 2022] DELETE /identity/v3/projects/c973f25451bc4792905503cbd1b6f974 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:14.028708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.028995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.029303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.049520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:14.051031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:14.119197 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1256/2498] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:14.127528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.127819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.128100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.148304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:14.149506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:14.157477 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1243/2499] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:14.161961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.171814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269585b-a6a6-42bd-b446-cf3e08fc7c13 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.176370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.176965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.177242 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.177512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.178154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:14.178741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.180350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.192176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1257/2500] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:14.196473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.206210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ba8b8-9665-4bac-888c-a7d8fe7ff323 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.211074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.211694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.211978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.212310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.212980 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.215013 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.242561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1244/2501] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:14 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:14.247217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.261777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6aa7-6355-40c7-8022-2a6ee912143a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.292206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:14.326471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.327085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.327363 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.327631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.328378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.330164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.355438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1258/2502] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:14 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:14.356750 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.369042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510be03-d1e2-4b17-bda6-41caf98e83e4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.375294 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.375942 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.376205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.376468 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.377123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.378780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.390208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1245/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:14.394303 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.404393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd855d-025d-469c-9cc3-a6a57d34e13a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.409051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.409668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.409949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.410218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.410883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.412495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112020-0b59-47b9-9a41-d632e36d0cf7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.426506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1259/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:14.427670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.438606 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4c1d-c5db-4f19-b6de-e6d8897b4ad0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.443265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.443931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.444213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.444489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] PATH_INFO: `/v3/projects/a7447ed8ef95479cba6ee39add96170f/users/e31a7afd2499465bbf18f6ab4c301d6b/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.459818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7447ed8ef95479cba6ee39add96170f, user_id=e31a7afd2499465bbf18f6ab4c301d6b, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.462447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.464628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:14.476670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1246/2505] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:14 2022] PUT /identity/v3/projects/a7447ed8ef95479cba6ee39add96170f/users/e31a7afd2499465bbf18f6ab4c301d6b/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:14.482608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce419dc-db46-4091-92b9-0a5fe59d37bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.482886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce419dc-db46-4091-92b9-0a5fe59d37bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.483153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce419dc-db46-4091-92b9-0a5fe59d37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.503087 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ce419dc-db46-4091-92b9-0a5fe59d37bb None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:14.504313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ce419dc-db46-4091-92b9-0a5fe59d37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:14.563814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1260/2506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:14.573474 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:14.575206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:14.634707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46adc0-3ff1-4cff-858a-3ebccef9c59e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:14.638575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:14.639183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:14.639455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:14.639721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:14.648970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:14.650450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:14.659625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1247/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:15.316391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48778-2090-4082-a478-1f644a598482 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.316889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48778-2090-4082-a478-1f644a598482 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.316999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48778-2090-4082-a478-1f644a598482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.346973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-48f48778-2090-4082-a478-1f644a598482 None None] MFA Rules not processed for user `e31a7afd2499465bbf18f6ab4c301d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:15.348436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48f48778-2090-4082-a478-1f644a598482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:15.424700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1261/2508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:15.429559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.439412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56f23f-aa5c-4a50-86ed-c9f5f0bc27d1 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.444161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.444784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.445064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.445334 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.445969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.447918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.478327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1248/2509] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:15 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:15.482148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48778-2090-4082-a478-1f644a598482 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.493049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48778-2090-4082-a478-1f644a598482 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.536723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:15.555259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.555881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.556214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.556444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.557088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.559632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.581101 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1262/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:15 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:15.585151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.597586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5d5ce-d312-44c8-ac0d-c9e6df8670c7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.605101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.605757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.606040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.606344 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.607273 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.610176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.629210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1249/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:13:15.633628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.645409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30f29-7f0d-4fc0-a29c-b4170ecdb826 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.650244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.650948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.651228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.651503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] PATH_INFO: `/v3/projects/dde9e648256c452789e3220fb8a14da0/users/a75a07a7cef24f88b1ddc8af8b249bb2/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.666567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde9e648256c452789e3220fb8a14da0, user_id=a75a07a7cef24f88b1ddc8af8b249bb2, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.669277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.682321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1263/2512] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:15 2022] PUT /identity/v3/projects/dde9e648256c452789e3220fb8a14da0/users/a75a07a7cef24f88b1ddc8af8b249bb2/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:15.686887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.696756 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd403fd-7040-4c2d-81fc-b942fbc11acb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.753333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.754037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.754342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.754614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.755243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.757170 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b747-2521-4057-ab78-a94626578927 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.768644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1250/2513] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:15.772944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:15.783219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf7a6-d590-44ed-a3a9-8aceb35aa42d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:15.787797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:15.788444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:15.788723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:15.788999 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] PATH_INFO: `/v3/projects/dde9e648256c452789e3220fb8a14da0/users/a75a07a7cef24f88b1ddc8af8b249bb2/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:15.790924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde9e648256c452789e3220fb8a14da0, user_id=a75a07a7cef24f88b1ddc8af8b249bb2, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:15.793600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:15.803908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1264/2514] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:15 2022] PUT /identity/v3/projects/dde9e648256c452789e3220fb8a14da0/users/a75a07a7cef24f88b1ddc8af8b249bb2/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:16.445388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:16.445906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:16.446016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:16.474799 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] MFA Rules not processed for user `a75a07a7cef24f88b1ddc8af8b249bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:16.476040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:16.529579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:16.558427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1251/2515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:17.614052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:17.683700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65695-0e72-40e5-bfb5-8bc7ffef3f8f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:17.688454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:17.688779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:17.689054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:17.689320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] PATH_INFO: `/v3/users/e31a7afd2499465bbf18f6ab4c301d6b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:17.690454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31a7afd2499465bbf18f6ab4c301d6b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:17.692393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:17.750404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31a7afd2499465bbf18f6ab4c301d6b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:17.757377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31a7afd2499465bbf18f6ab4c301d6b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:17.770147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31a7afd2499465bbf18f6ab4c301d6b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:17.770937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31a7afd2499465bbf18f6ab4c301d6b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:17.771547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31a7afd2499465bbf18f6ab4c301d6b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:17.786351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1265/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:17 2022] DELETE /identity/v3/users/e31a7afd2499465bbf18f6ab4c301d6b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:17.992154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:18.014471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de650b4-2a43-46ec-952c-137f98156c0b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:18.086788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:18.087540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.087817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.088088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] PATH_INFO: `/v3/projects/a7447ed8ef95479cba6ee39add96170f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.089198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7447ed8ef95479cba6ee39add96170f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:18.091424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:18.136425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7447ed8ef95479cba6ee39add96170f', 'request_id': 'req-56b08d83-ea14-4b47-ad32-c9e098b70534'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.144723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7447ed8ef95479cba6ee39add96170f', 'request_id': 'req-56b08d83-ea14-4b47-ad32-c9e098b70534'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.150254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7447ed8ef95479cba6ee39add96170f', 'request_id': 'req-56b08d83-ea14-4b47-ad32-c9e098b70534'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.161528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] The token cache is being invalidate because project a7447ed8ef95479cba6ee39add96170f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:18.161814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.162576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.164040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1252/2517] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:17 2022] DELETE /identity/v3/projects/a7447ed8ef95479cba6ee39add96170f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:18.168522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:18.169901 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:18.182741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae903ac-7222-4515-9fc2-15ac63538587 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:18.191878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:18.241325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:18.241961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.242239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.242561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] PATH_INFO: `/v3/users/a75a07a7cef24f88b1ddc8af8b249bb2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.243773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75a07a7cef24f88b1ddc8af8b249bb2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:18.245672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:18.291054 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75a07a7cef24f88b1ddc8af8b249bb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.298698 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75a07a7cef24f88b1ddc8af8b249bb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.312597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75a07a7cef24f88b1ddc8af8b249bb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.313312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75a07a7cef24f88b1ddc8af8b249bb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.313918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb65ce0-ec04-46f2-b502-09365132bd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75a07a7cef24f88b1ddc8af8b249bb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.327612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1266/2518] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:18 2022] DELETE /identity/v3/users/a75a07a7cef24f88b1ddc8af8b249bb2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:18.501960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:18.503730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:18.520012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d83-ea14-4b47-ad32-c9e098b70534 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:18.578346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:18.578905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.579180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.579448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] PATH_INFO: `/v3/projects/dde9e648256c452789e3220fb8a14da0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.580545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde9e648256c452789e3220fb8a14da0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:18.582475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:18.599524 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:18.631974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde9e648256c452789e3220fb8a14da0', 'request_id': 'req-16a0b22d-9bcc-49a1-b67b-3666079068df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.639663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde9e648256c452789e3220fb8a14da0', 'request_id': 'req-16a0b22d-9bcc-49a1-b67b-3666079068df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.646535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde9e648256c452789e3220fb8a14da0', 'request_id': 'req-16a0b22d-9bcc-49a1-b67b-3666079068df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.657570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] The token cache is being invalidate because project dde9e648256c452789e3220fb8a14da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:18.657836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.658500 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-16a0b22d-9bcc-49a1-b67b-3666079068df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:18.659977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1253/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:18 2022] DELETE /identity/v3/projects/dde9e648256c452789e3220fb8a14da0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:18.665015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.665499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.665598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.687237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:18.688557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:18.873028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1267/2520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:18.880335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.880622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.880898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.900881 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:18.902042 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:18.909778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1254/2521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:18.913991 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:18.924332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d0e5-a0b4-4e48-a76e-8b2a661f2faf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:18.929237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:18.929870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.930143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.930443 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.931082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:18.931383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:18.932966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:18.945630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1268/2522] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:18.950057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:18.960064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426face-15bc-441f-be2c-9f2a857eabe0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:18.964683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:18.965329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:18.965611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:18.965883 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:18.966560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:18.968460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:18.996857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1255/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:18 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:19.001432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.011292 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05d2c-7011-48ca-8e71-e7cf086d92c1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.026925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:19.077506 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.078118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.078430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.078714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.079321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.081221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.103737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1269/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:19 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:19.108733 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.118941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cd34-52be-44f0-8af7-0bbce93a5325 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.124421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.125074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.125465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.125743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.126480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.128355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.145303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1256/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:19.146520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.161531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0188b95-fcf1-4876-83ce-1b51c0eaa780 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.166626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.167233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.167513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.167783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.169085 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.172052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ee327-7082-409a-b991-756da91a5f1a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.189280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1270/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:19.193604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.203803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b48fc-2938-472c-9e7f-0b52f0695800 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.208807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.209493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.209773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.210046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] PATH_INFO: `/v3/projects/59c8bc2417c448f684e97a385082083c/users/0ec896ea5c05486b8fd263b8412a6750/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.225102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c8bc2417c448f684e97a385082083c, user_id=0ec896ea5c05486b8fd263b8412a6750, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.228968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.245602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1257/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:19 2022] PUT /identity/v3/projects/59c8bc2417c448f684e97a385082083c/users/0ec896ea5c05486b8fd263b8412a6750/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:19.259036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.259315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.259589 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.288080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] MFA Rules not processed for user `0ec896ea5c05486b8fd263b8412a6750`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:19.289324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:19.357717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1271/2528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:19.362184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.474232 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc109-d5d4-419a-af93-214df4b005d9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.479134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.479737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.480016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.480286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.481475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.483397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.516040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1258/2529] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:19 2022] POST /identity/v3/projects => generated 357 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:19.520150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.531648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a3e01-3459-4347-b60c-1c89d2e1c74f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.592322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.592927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.593318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.593630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.594253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.597114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.622236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1272/2530] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:19 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:19.626767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.637755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e6b9e-a736-4cb8-a1b2-95126f1c748d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.643116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.643872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.644156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.644440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.645174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.647073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.662304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1259/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:19.664150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.674658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47983e61-c703-4e93-b1b9-a4fbf0a1e559 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.679863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.680859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.681143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.681409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] PATH_INFO: `/v3/projects/f2a18e32919644c08415a0a84d0d3d9b/users/741d7a2959344948a2ba5a912d6f35bc/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.696377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a18e32919644c08415a0a84d0d3d9b, user_id=741d7a2959344948a2ba5a912d6f35bc, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.699975 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.702513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:19.718349 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1273/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:19 2022] PUT /identity/v3/projects/f2a18e32919644c08415a0a84d0d3d9b/users/741d7a2959344948a2ba5a912d6f35bc/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:19.722227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.732378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebc1a-db32-4dd6-b7fd-95e6f7734567 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.743627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:19.790506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.791032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.791309 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.791575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.792203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.793814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936454d5-2e1c-40cb-a702-b9364e33848a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.803753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1260/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:19.807966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.818333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1375-e07a-4a8e-a0d1-cf0aec801b00 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:19.823048 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:19.823689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.823969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.824742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] PATH_INFO: `/v3/projects/f2a18e32919644c08415a0a84d0d3d9b/users/741d7a2959344948a2ba5a912d6f35bc/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.826670 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a18e32919644c08415a0a84d0d3d9b, user_id=741d7a2959344948a2ba5a912d6f35bc, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:19.829413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:19.841512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1274/2534] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:19 2022] PUT /identity/v3/projects/f2a18e32919644c08415a0a84d0d3d9b/users/741d7a2959344948a2ba5a912d6f35bc/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:19.851855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:19.852140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:19.852417 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:19.881573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] MFA Rules not processed for user `741d7a2959344948a2ba5a912d6f35bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:19.882815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:19.974855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1261/2535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:19.986399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:19.988167 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:20.044794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d10e-536b-4970-b29e-00a732e5ed31 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:20.048505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:20.049104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:20.049383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:20.049648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:20.059311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:20.060837 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115cf5d-53f1-4529-9584-879df69d794a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:20.070685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1275/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:20.151983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:20.161754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50059363-9d13-4a53-a3da-7d54a52aeba1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:20.165372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:20.165968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:20.166246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:20.166553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:20.233268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:20.234880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:20.243996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1262/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:29.073584 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:29.074049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:29.074049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:29.094949 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:29.096243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:29.157159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1276/2538] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:29.200612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:29.202670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:29.243934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:29.282172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fff55b-f729-499c-a6e2-8d228c38ee55 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:29.287915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:29.288516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:29.288794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:29.289066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:29.297038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:29.298666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09bdf6-54a1-4fd6-9b5e-ba1e866ec73f service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:29.310918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1263/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:31.285515 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:31.286927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:31.351742 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b7fd0-12f2-424f-b089-36a8784ba7f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:31.355431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:31.356057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:31.356337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:31.356611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:31.358467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:31.370227 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:31.371749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:31.381402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1277/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:31.978319 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:31.978943 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:31.979220 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:32.000491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:32.001689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:32.009510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1264/2541] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:32.025070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:32.026552 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:32.049218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09c4d-4ee5-4877-8e5e-ff988e40691f service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:32.055027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:32.055733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:32.055906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:32.056173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:32.065195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:32.066842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:32.076665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1278/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:34.547604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:34.549251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:34.640652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:34.642173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:34.648880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94040-38fb-4f62-af90-09008ac261f3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:34.656241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:34.656925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:34.657035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dac7-f7f2-4f30-a6ed-349405cc8cf3 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:34.657210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:34.657482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:34.659223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:34.661587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:34.662205 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:34.662512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:34.662782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] PATH_INFO: `/v3/users/6bb8f9c24bbf460dab2bfb8ae539b374` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:34.663898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb8f9c24bbf460dab2bfb8ae539b374)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:34.665804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:34.671446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:34.674848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:34.676577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:34.688707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1265/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:34.718258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb8f9c24bbf460dab2bfb8ae539b374'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:34.726047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb8f9c24bbf460dab2bfb8ae539b374'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:34.737766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb8f9c24bbf460dab2bfb8ae539b374'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:34.738488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb8f9c24bbf460dab2bfb8ae539b374'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:34.739086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-948b0789-1b50-4e88-925a-8169635b03fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb8f9c24bbf460dab2bfb8ae539b374'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:34.754254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1279/2544] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:34 2022] DELETE /identity/v3/users/6bb8f9c24bbf460dab2bfb8ae539b374 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:34.926209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:34.938566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88cb5-4b2d-438b-ad88-7489e1d42c3d service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.012562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.013202 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.013483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.013795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] PATH_INFO: `/v3/projects/d659665b94294169af30c3d5ecabadbf` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.014962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d659665b94294169af30c3d5ecabadbf)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.016918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.065337 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:35.069492 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd659665b94294169af30c3d5ecabadbf', 'request_id': 'req-ec99ca88-4d88-41e7-b183-a334904723d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.079369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd659665b94294169af30c3d5ecabadbf', 'request_id': 'req-ec99ca88-4d88-41e7-b183-a334904723d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.086573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd659665b94294169af30c3d5ecabadbf', 'request_id': 'req-ec99ca88-4d88-41e7-b183-a334904723d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.100821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] The token cache is being invalidate because project d659665b94294169af30c3d5ecabadbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:35.101122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.101791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ec99ca88-4d88-41e7-b183-a334904723d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.104028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1266/2545] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:34 2022] DELETE /identity/v3/projects/d659665b94294169af30c3d5ecabadbf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:35.111507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.111862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.112232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.136445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:35.137647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.210461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1280/2546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:35.220407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.220698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.220972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.242295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:35.243519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.256506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1267/2547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:35.261042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.272803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada34ee-f329-40ba-85dd-0cab1ba6f838 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.283687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.284560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.285165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.285165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.285779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:35.286091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.287778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1353-0f1f-436e-8146-806d40232823 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.302864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1281/2548] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:13:35.304793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.314174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b6a5-e1d8-4fd4-a95f-20c9649966eb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.322238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.322890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.323165 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.323547 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.324181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.326711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.329998 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.330401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.330746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.351905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:35.353519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.359763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1268/2549] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:35.364241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.365875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1282/2550] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:35.386372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.387609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.431759 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665d74-4f36-4201-bbf3-2cdd9ae9a155 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.437166 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.437800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.438085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.438392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.439027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.440935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.460900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:35.463222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1269/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:35.464050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.465813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.466147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1b7f-a99a-4fd3-a316-4e815fa353de None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.479299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1720-8f17-4b0b-b196-6c8d9a5b5f63 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.484223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.484850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.485147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.485402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] PATH_INFO: `/v3/users/0ec896ea5c05486b8fd263b8412a6750` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.486583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec896ea5c05486b8fd263b8412a6750)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.488490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.537241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.537841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.537948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec896ea5c05486b8fd263b8412a6750'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.538119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.538423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.538672 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec896ea5c05486b8fd263b8412a6750'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.540185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.545701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec896ea5c05486b8fd263b8412a6750'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.551435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.553013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.557996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec896ea5c05486b8fd263b8412a6750'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.558683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5904b38-2efb-4fa0-9b00-30c83e48cb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec896ea5c05486b8fd263b8412a6750'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:35.563478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1283/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:35.571274 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.572809 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.574306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1270/2553] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:35 2022] DELETE /identity/v3/users/0ec896ea5c05486b8fd263b8412a6750 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:35.580336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401705e-e55c-4505-8071-669f91a5856d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.580621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401705e-e55c-4505-8071-669f91a5856d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.580896 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401705e-e55c-4505-8071-669f91a5856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.587464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dcf9-08a6-4927-a6cf-81339b9d74ad service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.598126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=14,keystone:SELECT=80,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:35.609631 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4401705e-e55c-4505-8071-669f91a5856d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:35.612011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4401705e-e55c-4505-8071-669f91a5856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.661017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.661643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.661881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.662370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.663028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.664653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.678310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1284/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:35.681077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.688835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1271/2555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:35.695889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ff21-4200-49aa-bb01-37fb116cd3f8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.699032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401705e-e55c-4505-8071-669f91a5856d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.700389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4401705e-e55c-4505-8071-669f91a5856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.700648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.701918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.702196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.702500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.703141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.704730 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.715296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1285/2556] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:13:35.719665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.729606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298194-7b39-499e-82a9-40e515837349 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.734895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.735539 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.735813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.736084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] PATH_INFO: `/v3/projects/3673b213732a40d296768ee1d734269e/users/272f0920df6c43ed836b9b8f61119d22/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.751347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3673b213732a40d296768ee1d734269e, user_id=272f0920df6c43ed836b9b8f61119d22, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.753963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae15f-41e6-448c-83f6-131726f88781 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.760209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401705e-e55c-4505-8071-669f91a5856d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:35.764421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:35.765025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.765301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.765576 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.767410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1286/2557] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:35 2022] PUT /identity/v3/projects/3673b213732a40d296768ee1d734269e/users/272f0920df6c43ed836b9b8f61119d22/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:35.775242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:35.776798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:35.777501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:35.777779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:35.778049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:35.787062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1272/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:13:35.809320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] MFA Rules not processed for user `272f0920df6c43ed836b9b8f61119d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:35.811218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.853736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:35.880744 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1287/2559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:35.892605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:35.897081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:35.960519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c29af-99eb-4cdb-a1db-a2f061c164cf service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:36.009912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:36.010534 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.010812 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.011080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.020200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:36.021610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:36.031131 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1273/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:36.070930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:36.072534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:36.145711 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828c422-433f-4ee1-9219-15db6697c7f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:36.150738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:36.151407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.151663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.151930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] PATH_INFO: `/v3/projects/59c8bc2417c448f684e97a385082083c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.153701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c8bc2417c448f684e97a385082083c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:36.156088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:36.207781 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c8bc2417c448f684e97a385082083c', 'request_id': 'req-0fb155cf-869a-4ea4-814f-4c01ac399eee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.216337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c8bc2417c448f684e97a385082083c', 'request_id': 'req-0fb155cf-869a-4ea4-814f-4c01ac399eee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.224558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c8bc2417c448f684e97a385082083c', 'request_id': 'req-0fb155cf-869a-4ea4-814f-4c01ac399eee'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.241829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] The token cache is being invalidate because project 59c8bc2417c448f684e97a385082083c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:36.242112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.242793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.244263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1288/2561] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:36 2022] DELETE /identity/v3/projects/59c8bc2417c448f684e97a385082083c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:36.249639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:36.261727 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109a1b-8386-43fa-92b0-d388b6b21010 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:36.268706 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:36.329771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:36.330600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.330886 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.331160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] PATH_INFO: `/v3/users/741d7a2959344948a2ba5a912d6f35bc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.332329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=741d7a2959344948a2ba5a912d6f35bc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:36.334260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:36.386469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741d7a2959344948a2ba5a912d6f35bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.387189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741d7a2959344948a2ba5a912d6f35bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.394879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741d7a2959344948a2ba5a912d6f35bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.406891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741d7a2959344948a2ba5a912d6f35bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.407564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25b29b10-541d-4736-9cd2-1cd20c8ddd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741d7a2959344948a2ba5a912d6f35bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.421378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1274/2562] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:36 2022] DELETE /identity/v3/users/741d7a2959344948a2ba5a912d6f35bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:36.695311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:36.696760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:36.709497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb155cf-869a-4ea4-814f-4c01ac399eee admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:36.766746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:36.767306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.767582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.767852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] PATH_INFO: `/v3/projects/f2a18e32919644c08415a0a84d0d3d9b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.768944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a18e32919644c08415a0a84d0d3d9b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:36.770882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:36.781585 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:36.818408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a18e32919644c08415a0a84d0d3d9b', 'request_id': 'req-ef3ae579-081f-4b87-90c7-1426c972e612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.825766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a18e32919644c08415a0a84d0d3d9b', 'request_id': 'req-ef3ae579-081f-4b87-90c7-1426c972e612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.832080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a18e32919644c08415a0a84d0d3d9b', 'request_id': 'req-ef3ae579-081f-4b87-90c7-1426c972e612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.842043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] The token cache is being invalidate because project f2a18e32919644c08415a0a84d0d3d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:36.842356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.842985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef3ae579-081f-4b87-90c7-1426c972e612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:36.844444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1289/2563] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:36 2022] DELETE /identity/v3/projects/f2a18e32919644c08415a0a84d0d3d9b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:36.849375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.849930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.849930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.869687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:36.870941 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:36.940444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1275/2564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:36.949361 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.949646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:36.949924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:36.969836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:36.971068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:36.979468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1290/2565] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:36.984204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:36.994151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee777e0-9208-4321-b4eb-44edb1e0436c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:36.999027 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:36.999627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:36.999914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.000181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.000823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:37.001126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.002777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.014229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1276/2566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:37.018620 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.027593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e953ee7-e256-4b39-bd12-6e64cbb75667 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.032668 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.033251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.033522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.033786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.034438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.036355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.063985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1291/2567] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:37.068218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.078223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8f98-070d-4c7d-b31d-1cf5184be310 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.089495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:37.138446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.139039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.139315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.139583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.140195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.142123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.163627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1277/2568] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:37.167896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.178842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ffd96-d61e-4ed5-91e4-34c5d661dff9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.183521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.184146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.184417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.184682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.185313 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.186923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.196707 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1292/2569] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:37.200442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.212075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b1cf9-b648-4d7d-acb9-4387033d8258 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.217932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.218642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.219134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.219609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.220270 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.222339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24ee7-08de-44e3-b04e-c9dd9cac64ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.234693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1278/2570] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:37.238780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.248903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0925-5d3b-4140-a762-883626e92a85 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.253453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.254091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.254397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.254669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] PATH_INFO: `/v3/projects/5f4e2781af8345c2a97013a981de2816/users/6adf88450c884b5c8057ca39adfa561e/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.269805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4e2781af8345c2a97013a981de2816, user_id=6adf88450c884b5c8057ca39adfa561e, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.272393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.285560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1293/2571] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:37 2022] PUT /identity/v3/projects/5f4e2781af8345c2a97013a981de2816/users/6adf88450c884b5c8057ca39adfa561e/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:37.296100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.296390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.296669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.324852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] MFA Rules not processed for user `6adf88450c884b5c8057ca39adfa561e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:37.326673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:37.390026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1279/2572] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:37.394648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.457259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffb8a-4e25-49c6-b620-866a82d687ae admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.461943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.462581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.462854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.463122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.463748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.465652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.493116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1294/2573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:37.497275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.508332 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254024-5703-4b9d-b47e-5bf0614f9f42 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.570231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.570924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.571200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.571472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.572106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.574139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.597411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1280/2574] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:37.602102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.612789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4640-86ea-4c1c-938b-524e9aed576c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.617489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.618082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.619245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.619245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.619482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.620969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.633365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1295/2575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:37.639203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.649593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f5af-a48c-4cce-8ac2-a65dceb18aea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.654558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.655218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.655491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.655765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] PATH_INFO: `/v3/projects/b3b20dc140614e0e9bc87948c4c0551f/users/3bf3cc9732ea4b3eba8df42860262b2c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.667544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:37.673284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b20dc140614e0e9bc87948c4c0551f, user_id=3bf3cc9732ea4b3eba8df42860262b2c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.676773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.693936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1281/2576] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:37 2022] PUT /identity/v3/projects/b3b20dc140614e0e9bc87948c4c0551f/users/3bf3cc9732ea4b3eba8df42860262b2c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:37.697945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.710092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aec6f8-93f0-4619-b044-9685925ea97e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.718378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:37.770774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.771436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.771733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.771996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.772686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.774222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4099a52-85f2-43ee-9585-9eb560c17a65 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.784395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1296/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:13:37.788572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.799979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97477d3-8dc1-4a3d-bdc7-863991f1378f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:37.807078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:37.807811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.808159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.808510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] PATH_INFO: `/v3/projects/b3b20dc140614e0e9bc87948c4c0551f/users/3bf3cc9732ea4b3eba8df42860262b2c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.811047 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b20dc140614e0e9bc87948c4c0551f, user_id=3bf3cc9732ea4b3eba8df42860262b2c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:37.814060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:37.827180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1282/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:37 2022] PUT /identity/v3/projects/b3b20dc140614e0e9bc87948c4c0551f/users/3bf3cc9732ea4b3eba8df42860262b2c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:37.837691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a8a3-fdc5-4c3c-a1d4-2a1174e0e126 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:37.838040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a8a3-fdc5-4c3c-a1d4-2a1174e0e126 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:37.838394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a8a3-fdc5-4c3c-a1d4-2a1174e0e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:37.877853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f0c2a8a3-fdc5-4c3c-a1d4-2a1174e0e126 None None] MFA Rules not processed for user `3bf3cc9732ea4b3eba8df42860262b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:37.880069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0c2a8a3-fdc5-4c3c-a1d4-2a1174e0e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:37.955264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1297/2579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:37.966711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:37.968462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:38.025531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96dee-bf0d-4e9f-924d-b3f1a03a6d9a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:38.029046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:38.029662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:38.029936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:38.030204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:38.039075 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:38.040496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:38.050184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1283/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:13:38.395611 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:38.395897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:38.396165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:38.415922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:38.417177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:38.484531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1298/2581] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:38.500452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:38.501912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:38.581125 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762657e-4a3a-4a69-a118-33aeafdc3c29 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:38.586653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:38.587260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:38.587650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:38.587929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:38.596315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:38.597935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d1ecd-e884-4b62-87fd-cb140dda7631 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:38.610156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1284/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:39.413636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:39.423350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ca868-f3e3-4144-9ca6-2fff5849a2b8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:39.427888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:39.428757 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:39.429029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:39.429296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] PATH_INFO: `/v3/users/6adf88450c884b5c8057ca39adfa561e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:39.430445 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adf88450c884b5c8057ca39adfa561e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:39.432343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:39.460569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:39.478953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adf88450c884b5c8057ca39adfa561e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:39.486347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adf88450c884b5c8057ca39adfa561e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:39.498739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adf88450c884b5c8057ca39adfa561e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:39.499410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adf88450c884b5c8057ca39adfa561e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:39.500013 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adf88450c884b5c8057ca39adfa561e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:39.512259 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1299/2583] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:39 2022] DELETE /identity/v3/users/6adf88450c884b5c8057ca39adfa561e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:39.517021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:39.517836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:39.517836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:39.538953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:39.540159 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:39.601558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1285/2584] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:39.612251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:39.614137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:39.670590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250c12-cb99-4f82-a048-8e8051b4e332 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:39.674294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:39.674908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:39.675186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:39.675449 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:39.684451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:39.686512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:39.695610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1300/2585] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:39.964197 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:39.965691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:39.975177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:39.985299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5135b46-2efc-4204-a90c-9eb6042bc50b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:39.991769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:39.992415 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:39.992734 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:39.992939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] PATH_INFO: `/v3/projects/5f4e2781af8345c2a97013a981de2816` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:39.994203 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4e2781af8345c2a97013a981de2816)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:39.996008 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.046710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4e2781af8345c2a97013a981de2816', 'request_id': 'req-f56ca9bd-d07d-4157-9732-41e55a7d2a72'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.054029 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4e2781af8345c2a97013a981de2816', 'request_id': 'req-f56ca9bd-d07d-4157-9732-41e55a7d2a72'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.059633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4e2781af8345c2a97013a981de2816', 'request_id': 'req-f56ca9bd-d07d-4157-9732-41e55a7d2a72'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.070432 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] The token cache is being invalidate because project 5f4e2781af8345c2a97013a981de2816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:40.070719 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.071342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.072822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1286/2586] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:39 2022] DELETE /identity/v3/projects/5f4e2781af8345c2a97013a981de2816 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:40.076917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:40.086314 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba235a0-4165-4d36-8cfc-735cfe995c11 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:40.140254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:40.140869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.141147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.141410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] PATH_INFO: `/v3/users/3bf3cc9732ea4b3eba8df42860262b2c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.142612 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf3cc9732ea4b3eba8df42860262b2c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:40.144504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.200271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf3cc9732ea4b3eba8df42860262b2c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.202531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:40.209130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf3cc9732ea4b3eba8df42860262b2c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.223819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf3cc9732ea4b3eba8df42860262b2c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.224677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf3cc9732ea4b3eba8df42860262b2c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.225444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7f617899-52a6-48fb-b8d2-6b60f5fd0ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf3cc9732ea4b3eba8df42860262b2c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.240431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1301/2587] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:40 2022] DELETE /identity/v3/users/3bf3cc9732ea4b3eba8df42860262b2c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:40.527221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:40.528820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:40.546200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca9bd-d07d-4157-9732-41e55a7d2a72 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:40.603501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:40.604452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.604838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.605123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] PATH_INFO: `/v3/projects/b3b20dc140614e0e9bc87948c4c0551f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.606653 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b20dc140614e0e9bc87948c4c0551f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:40.609282 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.656144 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b20dc140614e0e9bc87948c4c0551f', 'request_id': 'req-d408887d-f630-4023-a2ec-3cf8b526c4e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.662578 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b20dc140614e0e9bc87948c4c0551f', 'request_id': 'req-d408887d-f630-4023-a2ec-3cf8b526c4e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.667974 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b20dc140614e0e9bc87948c4c0551f', 'request_id': 'req-d408887d-f630-4023-a2ec-3cf8b526c4e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.680060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] The token cache is being invalidate because project b3b20dc140614e0e9bc87948c4c0551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:40.680346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.680973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d408887d-f630-4023-a2ec-3cf8b526c4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:40.682575 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1287/2588] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:40 2022] DELETE /identity/v3/projects/b3b20dc140614e0e9bc87948c4c0551f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:40.687439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.687910 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.688022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.707086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:40.708330 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:40.766871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1302/2589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:40.775218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.775505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.775779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.796381 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:40.797590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:40.805851 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1288/2590] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:40.810412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:40.820486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6852d5b-e48b-40eb-af5e-7da7c907444c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:40.825427 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:40.826173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.826537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.826831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.827470 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:40.827770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:40.829467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.840890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1303/2591] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:40.845618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:40.854789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc0097-6728-433d-b1e2-59225eb3c0b2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:40.859992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:40.860577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.860859 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.861126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.861753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:40.863660 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.873321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:40.894867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1289/2592] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:40 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:40.896327 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:40.906004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ef6d-03c4-41d7-8bad-d8e276df15dc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:40.961348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:40.961884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:40.962164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:40.962462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:40.963077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:40.964983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:40.987342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1304/2593] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:40 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:40.991213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.002697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44568a3-b46c-47f7-a363-d8ff15d26319 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.007405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.008009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.008287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.008590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.009227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.010844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.020791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1290/2594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:41.024783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.035052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846671-1e98-471a-b849-978a88fd72dd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.039683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.040283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.040562 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.040836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.041471 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.043097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0f2a7-c017-44f7-ace3-3021bd4b324d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.054228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1305/2595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:41.058247 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.068823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894874-c9e3-493b-be24-389b3fd6602c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.073305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.073945 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.074221 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.074525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] PATH_INFO: `/v3/projects/fa5eb1cfb5cc42bd917263d2730734cd/users/bc1fc4a370a94fb3866a3fd809cd1ad1/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.088932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5eb1cfb5cc42bd917263d2730734cd, user_id=bc1fc4a370a94fb3866a3fd809cd1ad1, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.091650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.105225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1291/2596] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:41 2022] PUT /identity/v3/projects/fa5eb1cfb5cc42bd917263d2730734cd/users/bc1fc4a370a94fb3866a3fd809cd1ad1/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:41.116194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.116483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.116758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.144728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] MFA Rules not processed for user `bc1fc4a370a94fb3866a3fd809cd1ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:41.145922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.165042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:41.210886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1306/2597] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:41.215663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.277448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29085a-bd61-4cbb-94f2-af96bf8b1d78 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.282100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.282726 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.283006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.283277 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.283897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.285785 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.316890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1292/2598] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:41 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:41.318003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.329915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26ff1-e1e9-434c-bcda-4151711ce5e2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.387499 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.388108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.388435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.388703 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.389331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.391355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.416394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1307/2599] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:41 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:41.417730 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.429301 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80308-025e-4e3c-ba06-4af99fb9915e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.433876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.434512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.434797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.435068 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.435729 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.437353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.450395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1293/2600] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:41.455036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.465865 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d52bad-58e3-4dcc-872b-c9120badf424 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.471884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.472534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.472814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.473092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] PATH_INFO: `/v3/projects/bd70f9ec0c8948209e46162747cbc052/users/7c9dfeb0bbf148869d22907a3c9b6644/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.493818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd70f9ec0c8948209e46162747cbc052, user_id=7c9dfeb0bbf148869d22907a3c9b6644, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.496498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fe548-6290-4995-b844-c025c568a255 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.514384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1308/2601] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:41 2022] PUT /identity/v3/projects/bd70f9ec0c8948209e46162747cbc052/users/7c9dfeb0bbf148869d22907a3c9b6644/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:41.518379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.530229 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67686-5ed0-4e7b-9a6a-171f090401f4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.570563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.570863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.571246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.594130 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:41.595743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.618970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.619592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.619870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.620142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.620791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.622411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.632914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1294/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:41.636925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.647245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16b10-3b2a-4990-abd5-f8f6562548a4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.651911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.652561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.652840 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.653114 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] PATH_INFO: `/v3/projects/bd70f9ec0c8948209e46162747cbc052/users/7c9dfeb0bbf148869d22907a3c9b6644/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.655549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd70f9ec0c8948209e46162747cbc052, user_id=7c9dfeb0bbf148869d22907a3c9b6644, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.658156 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a573ef-ccda-4dc3-b499-59c40d843429 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.670250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1295/2603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:41 2022] PUT /identity/v3/projects/bd70f9ec0c8948209e46162747cbc052/users/7c9dfeb0bbf148869d22907a3c9b6644/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:41.673561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1309/2604] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:41.681623 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.681910 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.682185 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.703037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.703586 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:41.704853 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.712558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] MFA Rules not processed for user `7c9dfeb0bbf148869d22907a3c9b6644`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:41.714387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.740162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:41.783094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0349694-7e97-4cd6-b4c6-2020c70a8ea3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.785379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1296/2605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:41.796788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.798135 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.850334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.850936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.851241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.851479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.855297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bda6e-da50-4c01-9feb-db3f8409976f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.859665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.860275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.860557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.860829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:41.873596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.875096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.885238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1297/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:13:41.911780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:41.913355 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023b46-f5e9-45c4-bc6b-d99368dc7ad6 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:41.923365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1310/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:13:41.935821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:41.937968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:41.949211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1587-ea66-4fc4-b697-606317c95a76 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:41.952981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:41.953681 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:41.954003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:41.954363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:42.018579 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:42.020021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:42.030032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1298/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:44.761375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:44.761953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:44.762053 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:44.781390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:44.782639 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:44.791079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1311/2609] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:44.807231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:44.808592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:44.824652 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840285bc-4481-457e-a31b-2ec6affa490f service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:44.831839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:44.832433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:44.832713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:44.833012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:44.841262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:44.843488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf52e06-1565-4a4e-ac9e-7d9d1a12e278 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:44.852696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1299/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:45.316488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:45.325965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acbf33-8508-4ddb-9476-fc2e7d40f61b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:45.331138 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:45.331748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:45.332018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:45.332281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] PATH_INFO: `/v3/users/bc1fc4a370a94fb3866a3fd809cd1ad1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:45.333451 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1fc4a370a94fb3866a3fd809cd1ad1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:45.335404 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:45.381006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1fc4a370a94fb3866a3fd809cd1ad1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.382176 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:45.390099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1fc4a370a94fb3866a3fd809cd1ad1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.401765 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1fc4a370a94fb3866a3fd809cd1ad1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.402409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1fc4a370a94fb3866a3fd809cd1ad1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.403019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1fc4a370a94fb3866a3fd809cd1ad1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.415281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1312/2611] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:45 2022] DELETE /identity/v3/users/bc1fc4a370a94fb3866a3fd809cd1ad1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:45.419693 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:45.419979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:45.420280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:45.439654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:45.440848 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:45.459236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:45.501745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1300/2612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:45.511381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:45.512784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:45.570726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5c903-2a4b-4bcb-8efb-46ce9ab91120 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:45.574392 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:45.574990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:45.575263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:45.575529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:45.585507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:45.586964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:45.596399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1313/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:45.883932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:45.885397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:45.897698 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692715a-7685-4f82-85d5-85f55b595a3c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:45.902377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:45.903019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:45.903307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:45.903611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] PATH_INFO: `/v3/projects/fa5eb1cfb5cc42bd917263d2730734cd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:45.904818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5eb1cfb5cc42bd917263d2730734cd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:45.907167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:45.954541 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5eb1cfb5cc42bd917263d2730734cd', 'request_id': 'req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.961292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5eb1cfb5cc42bd917263d2730734cd', 'request_id': 'req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.966815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5eb1cfb5cc42bd917263d2730734cd', 'request_id': 'req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.978245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] The token cache is being invalidate because project fa5eb1cfb5cc42bd917263d2730734cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:45.978553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.979740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:45.981088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1301/2614] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:45 2022] DELETE /identity/v3/projects/fa5eb1cfb5cc42bd917263d2730734cd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:45.985784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:45.995442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef444b-d3f3-4dda-95a5-0f5074e30da5 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.051682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.052332 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.052613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.052885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] PATH_INFO: `/v3/users/7c9dfeb0bbf148869d22907a3c9b6644` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.054336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9dfeb0bbf148869d22907a3c9b6644)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.056273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.106350 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9dfeb0bbf148869d22907a3c9b6644'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.113925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9dfeb0bbf148869d22907a3c9b6644'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.124667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:46.126872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9dfeb0bbf148869d22907a3c9b6644'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.127568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9dfeb0bbf148869d22907a3c9b6644'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.128214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1824a19d-f30d-40d9-aa66-40788bc3b743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9dfeb0bbf148869d22907a3c9b6644'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.143990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1314/2615] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:45 2022] DELETE /identity/v3/users/7c9dfeb0bbf148869d22907a3c9b6644 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:46.417052 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.418533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:46.431659 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc195d9-2ba0-4a11-8ef9-242897a3aa31 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.492839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.493469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.493749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.494045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] PATH_INFO: `/v3/projects/bd70f9ec0c8948209e46162747cbc052` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.495193 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd70f9ec0c8948209e46162747cbc052)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.497080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.542857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd70f9ec0c8948209e46162747cbc052', 'request_id': 'req-c822b2ce-fc15-4026-a0d0-6341e79755d3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.544519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:46.552297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd70f9ec0c8948209e46162747cbc052', 'request_id': 'req-c822b2ce-fc15-4026-a0d0-6341e79755d3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.559110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd70f9ec0c8948209e46162747cbc052', 'request_id': 'req-c822b2ce-fc15-4026-a0d0-6341e79755d3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.569958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] The token cache is being invalidate because project bd70f9ec0c8948209e46162747cbc052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:46.570245 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.570932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c822b2ce-fc15-4026-a0d0-6341e79755d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:46.572392 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1302/2616] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:46 2022] DELETE /identity/v3/projects/bd70f9ec0c8948209e46162747cbc052 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:46.577843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.578129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.578444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.598195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:46.599538 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:46.668601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1315/2617] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:46.676395 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.676679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.676958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.696930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:46.698117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:46.706503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1303/2618] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:46.710693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.720165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a5b5-5d71-427d-814d-e2295ee1d11c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.724756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.725348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.725626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.725895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.726566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:46.726871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.728463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.740037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1316/2619] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:46.744097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.753486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f1aa-2210-489c-9bb6-b41f83f6006c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.758006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.758627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.758904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.759176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.759804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.761724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.790704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1304/2620] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:46.794880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.810431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2f17a-3343-4df7-bf82-f358b8160763 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.887061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.887675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.888337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.888337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.888834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.891658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.921767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1317/2621] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:46 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:46.923120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.939989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6ef6-a93e-40cd-bbd7-79be22d96ae0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.945168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.945784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.946063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.946363 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.947017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.948603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:46.960361 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1305/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:13:46.964653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:46.977464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52302d3-fa36-41ab-888e-ce0235faa5e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:46.989952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:46.990906 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:46.991191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:46.991463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:46.992179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:46.993812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89202d-885b-43fc-b0e9-e0d48c83fde3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.006647 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1318/2623] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:13:47.010976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.022611 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349156-af8f-42c3-bce0-75d9cead9327 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.028134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.028819 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.029099 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.029374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] PATH_INFO: `/v3/projects/c254162ccf704f79b703d283ad35ee36/users/9762ed65117d46148f77eaa6d2ea7596/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.047938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c254162ccf704f79b703d283ad35ee36, user_id=9762ed65117d46148f77eaa6d2ea7596, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.050992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.068196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1306/2624] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:47 2022] PUT /identity/v3/projects/c254162ccf704f79b703d283ad35ee36/users/9762ed65117d46148f77eaa6d2ea7596/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:47.079939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.080324 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.080755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.116963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] MFA Rules not processed for user `9762ed65117d46148f77eaa6d2ea7596`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:47.118168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:47.163264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:47.189983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1319/2625] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:47.194345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.261105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ff30c-ccd5-4ae2-b08f-b11690295a8c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.265860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.266505 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.266782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.267053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.267688 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.269564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.296860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1307/2626] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:47 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:47.300852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.312264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b9d5-0b3c-45b5-b4e0-36538a4826ac None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.367689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.368285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.368559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.368823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.369430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.371360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.392425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1320/2627] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:47 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:47.396385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.406494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5f47-c1a9-46da-a749-6c76df655da5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.411050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.411643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.411921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.412190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.412822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.414452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.424683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1308/2628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:47.428732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.439280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16408e0d-e8de-4ea2-afb8-9a4a7123f580 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.443995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.444580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.444858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.445132 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] PATH_INFO: `/v3/projects/4b21144273504429b3f923aa0f1d7179/users/f7d90e9f52af47e4aeeee6d3274ea35a/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.460172 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b21144273504429b3f923aa0f1d7179, user_id=f7d90e9f52af47e4aeeee6d3274ea35a, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.462894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.475624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1321/2629] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:47 2022] PUT /identity/v3/projects/4b21144273504429b3f923aa0f1d7179/users/f7d90e9f52af47e4aeeee6d3274ea35a/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:47.479449 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.489139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3c5a-7352-4c40-a40e-c5e074d75596 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.533598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:47.547157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.547752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.548031 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.548327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.548956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.550585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dfc48-187f-4e0b-9c5c-5d51d93ca958 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.560401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1309/2630] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:47.565025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.575195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57849f-4045-451c-a6b6-381efef3b57b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.580289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.580914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.581186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.581457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] PATH_INFO: `/v3/projects/4b21144273504429b3f923aa0f1d7179/users/f7d90e9f52af47e4aeeee6d3274ea35a/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.583370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b21144273504429b3f923aa0f1d7179, user_id=f7d90e9f52af47e4aeeee6d3274ea35a, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.585960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.595804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1322/2631] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:47 2022] PUT /identity/v3/projects/4b21144273504429b3f923aa0f1d7179/users/f7d90e9f52af47e4aeeee6d3274ea35a/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:47.608004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.608408 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.608694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.636383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] MFA Rules not processed for user `f7d90e9f52af47e4aeeee6d3274ea35a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:47.637590 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:47.705005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1310/2632] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:47.715609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.717283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:47.773564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba34-42b0-4088-ba52-2e632e020e90 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.777240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.777829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.778105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.778432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.787147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.788563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:47.798590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1323/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:47.901565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:47.911137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b0ab-4a64-4899-8375-124dee284a3b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:47.914863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:47.915463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:47.915954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:47.916087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:47.994488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:47.996891 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25915f2c-53a8-45dd-b1b4-f1253b5a9eb7 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:48.008689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1311/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:50.849948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:50.902052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:50.935922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb6b3-6bcb-4bf7-94e8-7d09c4602dc2 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:50.941165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:50.941790 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:50.942064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:50.942364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] PATH_INFO: `/v3/users/9762ed65117d46148f77eaa6d2ea7596` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:50.943483 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9762ed65117d46148f77eaa6d2ea7596)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:50.945401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:50.993160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9762ed65117d46148f77eaa6d2ea7596'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.007773 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9762ed65117d46148f77eaa6d2ea7596'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.019813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9762ed65117d46148f77eaa6d2ea7596'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.020628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9762ed65117d46148f77eaa6d2ea7596'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.021239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9762ed65117d46148f77eaa6d2ea7596'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.034768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1324/2635] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:50 2022] DELETE /identity/v3/users/9762ed65117d46148f77eaa6d2ea7596 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:51.039317 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:51.039825 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:51.040046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:51.183838 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:51.185056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:51.244001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1312/2636] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:51.253662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:51.255100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:51.320002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fc73-5211-4e26-adec-0835148a126b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:51.323621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:51.324224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:51.324502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:51.324774 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:51.333567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:51.335059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:51.344942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1325/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:51.608357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:51.609885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:51.621820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d639bf7-9c4f-422d-afca-263a85cba94c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:51.627138 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:51.627814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:51.628082 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:51.628394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] PATH_INFO: `/v3/projects/c254162ccf704f79b703d283ad35ee36` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:51.629574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c254162ccf704f79b703d283ad35ee36)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:51.631605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:51.634004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:51.686844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c254162ccf704f79b703d283ad35ee36', 'request_id': 'req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.694596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c254162ccf704f79b703d283ad35ee36', 'request_id': 'req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.700275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c254162ccf704f79b703d283ad35ee36', 'request_id': 'req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.711633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] The token cache is being invalidate because project c254162ccf704f79b703d283ad35ee36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:51.711926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.712572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.714051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1313/2638] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:51 2022] DELETE /identity/v3/projects/c254162ccf704f79b703d283ad35ee36 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:51.718106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:51.727734 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b03b-20c7-48fe-a5a5-27e720ef510e service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:51.784343 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:51.784969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:51.785247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:51.785520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] PATH_INFO: `/v3/users/f7d90e9f52af47e4aeeee6d3274ea35a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:51.786665 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d90e9f52af47e4aeeee6d3274ea35a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:51.788581 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:51.790026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:51.835642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d90e9f52af47e4aeeee6d3274ea35a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.842973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d90e9f52af47e4aeeee6d3274ea35a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.855797 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d90e9f52af47e4aeeee6d3274ea35a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.856568 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d90e9f52af47e4aeeee6d3274ea35a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.857229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6bb9726-292f-4a78-b66c-eab6753064dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d90e9f52af47e4aeeee6d3274ea35a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:51.871519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1326/2639] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:51 2022] DELETE /identity/v3/users/f7d90e9f52af47e4aeeee6d3274ea35a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:52.439235 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.440798 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:52.454882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8df8-7a9d-4fbf-a2fe-3dc699d8cde9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.511718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.512343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.512633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.512884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] PATH_INFO: `/v3/projects/4b21144273504429b3f923aa0f1d7179` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.513979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b21144273504429b3f923aa0f1d7179)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.515901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.562345 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b21144273504429b3f923aa0f1d7179', 'request_id': 'req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:52.570299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b21144273504429b3f923aa0f1d7179', 'request_id': 'req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:52.575929 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b21144273504429b3f923aa0f1d7179', 'request_id': 'req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:52.586655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] The token cache is being invalidate because project 4b21144273504429b3f923aa0f1d7179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:52.586939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:52.587565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5e8661ec-5bd6-4715-afbb-2e3b5a1f6d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:52.589039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1314/2640] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:52 2022] DELETE /identity/v3/projects/4b21144273504429b3f923aa0f1d7179 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:52.594496 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.594782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.595051 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.615014 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:52.616208 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:52.677780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1327/2641] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:52.686384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.686692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.686961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.706036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:52.707262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:52.714921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1315/2642] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:52.719622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.729252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e808d-3479-4ee6-8e11-f89a6d017eae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.735049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.735787 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.736065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.736333 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.736972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:52.737273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.738931 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.751123 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1328/2643] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:52.755472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.764602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3af1f8-70fc-44d6-8f1d-1f63231c7bf6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.769200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.769789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.770063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.770354 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.770979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.772820 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.788136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:52.803077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1316/2644] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:52 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:52.807718 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.817689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb85be-ebbf-4884-8e77-9accb7934209 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.873220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.874195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.874195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.874524 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.875173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.877209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.889408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:52.902380 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1329/2645] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:52 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:52.907036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.917155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36786724-a5f8-4616-9641-5065bbb87f61 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.922382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.922966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.923237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.923529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.924155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.925707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.935601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1317/2646] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:52.939374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.949113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4e9-a52a-473c-90f6-c54b22ccc210 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.953779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.954566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.954932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.955222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:52.955900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:52.957484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4560-82ca-48f4-a986-1db7c407172d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:52.968605 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1330/2647] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:52.972776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:52.988773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62360a37-ce82-4743-a4a9-7698599862e6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:52.994070 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:52.994677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:52.994907 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:52.995176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] PATH_INFO: `/v3/projects/0aca11bf02144853ae29987d7c5aaad9/users/e1a38c062d374068b141d998c85631f0/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.010290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aca11bf02144853ae29987d7c5aaad9, user_id=e1a38c062d374068b141d998c85631f0, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.012959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.026404 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1318/2648] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:52 2022] PUT /identity/v3/projects/0aca11bf02144853ae29987d7c5aaad9/users/e1a38c062d374068b141d998c85631f0/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:53.038046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.038358 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.038660 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.067547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] MFA Rules not processed for user `e1a38c062d374068b141d998c85631f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:53.068557 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:53.142608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1331/2649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:53.147143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.207050 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404831-80c3-4c8e-a051-9b735f229e3a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.211553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.212142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.212419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.212687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.213306 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.215211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.242556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1319/2650] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:53.246479 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.257100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0893-9566-4ced-8ea1-33fa5f5985c0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.318979 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.319754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.320050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.320310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.320970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.323093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.355135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1332/2651] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:53 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:53.359189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.369666 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8f8a-4b43-4b82-9a6d-0a6c0f4f15c7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.375147 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.375742 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.376016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.376281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.376914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.378549 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.388844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1320/2652] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:53.393635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.403631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eaebc-c69f-44d2-afff-002afd4c8e64 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.408368 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.409016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.409286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.409553 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] PATH_INFO: `/v3/projects/e40bb67b1243411fa7e511dcbee863f4/users/88fbb79710ee40c0a69e7422692985c6/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.425186 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40bb67b1243411fa7e511dcbee863f4, user_id=88fbb79710ee40c0a69e7422692985c6, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.427911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.442018 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1333/2653] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:53 2022] PUT /identity/v3/projects/e40bb67b1243411fa7e511dcbee863f4/users/88fbb79710ee40c0a69e7422692985c6/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:53.445972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.456863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b44c-89ba-4083-862b-3d3402b6caef admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.512377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.512948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.513254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.513527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.514868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.516475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f85f7-61ae-43bc-a448-0545bd644e8e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.526011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1321/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:53.530241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.542489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e24b-a384-4e2b-9aea-4902cb4588a9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.547545 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.548254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.548527 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.548819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] PATH_INFO: `/v3/projects/e40bb67b1243411fa7e511dcbee863f4/users/88fbb79710ee40c0a69e7422692985c6/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.551029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40bb67b1243411fa7e511dcbee863f4, user_id=88fbb79710ee40c0a69e7422692985c6, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.554175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.568415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1334/2655] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:53 2022] PUT /identity/v3/projects/e40bb67b1243411fa7e511dcbee863f4/users/88fbb79710ee40c0a69e7422692985c6/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:53.632532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.632814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.633085 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.660587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] MFA Rules not processed for user `88fbb79710ee40c0a69e7422692985c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:53.661790 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:53.678219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:53.730599 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1322/2656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:53.742695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.744468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:53.779141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:53.809005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a023c5a-bc1d-4ef3-8a92-1fc09fa02257 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.813049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.813661 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.813932 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.814255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:53.823321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:53.824748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:53.839500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1335/2657] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:53.926728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:53.937263 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff6b8-88f3-4d09-8cb4-d0da0f13dcce None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:53.940852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:53.941435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:53.941705 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:53.941970 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:54.005954 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:54.007467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854e56-17f8-4c95-9567-71c7f9e6ba58 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:54.016732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1323/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:54.298239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:54.367256 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56236a-ab47-4e9c-9c63-79b65562be22 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:54.372073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:54.372727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:54.373005 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:54.373946 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] PATH_INFO: `/v3/users/e1a38c062d374068b141d998c85631f0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:54.375131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a38c062d374068b141d998c85631f0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:54.377077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:54.423234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a38c062d374068b141d998c85631f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:54.430893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a38c062d374068b141d998c85631f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:54.445258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a38c062d374068b141d998c85631f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:54.446093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a38c062d374068b141d998c85631f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:54.446725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a38c062d374068b141d998c85631f0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:54.460357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1336/2659] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:54 2022] DELETE /identity/v3/users/e1a38c062d374068b141d998c85631f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:54.465123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:54.465713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:54.465713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:54.486956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:54.488233 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:54.557279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1324/2660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:54.567388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:54.568803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:54.624954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:54.628966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afa7c-d528-47f5-ad94-d6d6d800db6c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:54.634520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:54.635134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:54.635408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:54.635678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:54.645719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:54.647219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:54.656626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1337/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:55.024787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:55.026472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:55.040537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ae272-3fc9-4ded-acf6-8abfbc3416e4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:55.052465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:55.053323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:55.053959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:55.056234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] PATH_INFO: `/v3/projects/0aca11bf02144853ae29987d7c5aaad9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:55.058136 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aca11bf02144853ae29987d7c5aaad9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:55.060026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:55.108406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:55.109866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aca11bf02144853ae29987d7c5aaad9', 'request_id': 'req-92531300-0247-4535-882b-66618e2c6e1d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.118858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aca11bf02144853ae29987d7c5aaad9', 'request_id': 'req-92531300-0247-4535-882b-66618e2c6e1d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.125060 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aca11bf02144853ae29987d7c5aaad9', 'request_id': 'req-92531300-0247-4535-882b-66618e2c6e1d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.136205 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] The token cache is being invalidate because project 0aca11bf02144853ae29987d7c5aaad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:55.136520 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.137316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.139497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1325/2662] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:55 2022] DELETE /identity/v3/projects/0aca11bf02144853ae29987d7c5aaad9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:55.143504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:55.153251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa7cb-abf7-459a-aee9-b69e2c38e7d3 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:55.237672 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:55.242504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:55.242963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:55.243323 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] PATH_INFO: `/v3/users/88fbb79710ee40c0a69e7422692985c6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:55.245830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fbb79710ee40c0a69e7422692985c6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:55.248258 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:55.338180 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fbb79710ee40c0a69e7422692985c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.348375 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fbb79710ee40c0a69e7422692985c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.365364 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fbb79710ee40c0a69e7422692985c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.367370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fbb79710ee40c0a69e7422692985c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.368111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b242423c-dbe1-477f-b7fd-a506b3596fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fbb79710ee40c0a69e7422692985c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.392212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1338/2663] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:13:55 2022] DELETE /identity/v3/users/88fbb79710ee40c0a69e7422692985c6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:55.709684 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:55.713268 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:55.734478 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92531300-0247-4535-882b-66618e2c6e1d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:55.824876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:55.825545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:55.825826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:55.826102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] PATH_INFO: `/v3/projects/e40bb67b1243411fa7e511dcbee863f4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:55.828377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40bb67b1243411fa7e511dcbee863f4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:55.830689 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:55.899669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40bb67b1243411fa7e511dcbee863f4', 'request_id': 'req-665672c6-6100-4bcc-958a-15abadcd6b65'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.909289 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40bb67b1243411fa7e511dcbee863f4', 'request_id': 'req-665672c6-6100-4bcc-958a-15abadcd6b65'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.916140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40bb67b1243411fa7e511dcbee863f4', 'request_id': 'req-665672c6-6100-4bcc-958a-15abadcd6b65'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.930898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] The token cache is being invalidate because project e40bb67b1243411fa7e511dcbee863f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:13:55.931264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.943151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-665672c6-6100-4bcc-958a-15abadcd6b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:13:55.949015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1326/2664] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:13:55 2022] DELETE /identity/v3/projects/e40bb67b1243411fa7e511dcbee863f4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:13:55.950990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:55.951365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:55.951783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:55.992801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:55.994050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:56.058369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1339/2665] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:13:56.065211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.065530 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.065808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.094140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:56.095007 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:56.103555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1327/2666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:56.107903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.117636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34dfaa-3e4c-4a56-9fc9-3542ce7985f6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.122688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.123346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.123623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.123895 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.124542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:13:56.125498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.127360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.135282 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:56.142528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1340/2667] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:13:56.146496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.161993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72f8c2-adb6-43ee-9afa-0073540cdeb0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.167213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.167876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.168149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.168414 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.169053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.171073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.204146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1328/2668] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:56 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:13:56.208394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.219410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40900969-f991-4cee-9768-6fa7b10aa44b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.285650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.286341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.286575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.286848 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.287482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.289422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.311728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1341/2669] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:56 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:56.316012 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.327816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d295-9b0d-4ebc-8e41-348580121c42 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.332583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.333181 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.333455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.333753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.334470 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.336078 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.347817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1329/2670] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:56.351859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.362237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba4b-6182-4c6c-8263-59b71a677614 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.366894 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.367486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.367762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.368030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.368667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.370249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bbab-aeb8-4c50-afe2-fe7783bc12c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.381322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1342/2671] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:56.386497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.397464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff3836-2d41-4490-ae62-7b5c8b59c6cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.402622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.403192 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.403574 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.403852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] PATH_INFO: `/v3/projects/3f5761796a814c95ab1670005c476bc4/users/bcb7635d94f845459d6360d1a4e11004/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.418196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5761796a814c95ab1670005c476bc4, user_id=bcb7635d94f845459d6360d1a4e11004, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.420857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.434410 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1330/2672] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:56 2022] PUT /identity/v3/projects/3f5761796a814c95ab1670005c476bc4/users/bcb7635d94f845459d6360d1a4e11004/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:56.439988 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e41d5-6897-47fb-8fc0-2e1ad8aa8ce8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.440273 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e41d5-6897-47fb-8fc0-2e1ad8aa8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.440546 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e41d5-6897-47fb-8fc0-2e1ad8aa8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.460409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5e6e41d5-6897-47fb-8fc0-2e1ad8aa8ce8 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:56.461614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5e6e41d5-6897-47fb-8fc0-2e1ad8aa8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:56.519266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1343/2673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:56.531183 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:56.533195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:56.541120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:56.595949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269e90c-9979-4a01-8c95-597520c97458 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:56.599562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:56.600248 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:56.600635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:56.600967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:56.612983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:56.614627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:56.623811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1331/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:57.281601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.281943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.282318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.322735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] MFA Rules not processed for user `bcb7635d94f845459d6360d1a4e11004`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:57.324113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:57.407025 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1344/2675] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:57.411755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.423299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fcd14-6672-421c-a533-98730cc44ed8 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.431448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.432230 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.432602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.433096 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.433904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.436774 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.466496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1332/2676] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:13:57 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:57.470912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.481574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710e21d-77d7-4731-8036-77e9e12271ee None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.485852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:57.554733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.555440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.555788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.556279 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.557038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.559076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.581840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1345/2677] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:13:57 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:13:57.586927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.598398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf1451-15be-473c-8541-3b00daeb29f4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.604312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.604986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.605302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.605598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.606347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.608175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.622439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1333/2678] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:57.632057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.643995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebada1-e640-4cb0-9846-7e06b4ed279a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.648685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.649340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.649616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.649887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] PATH_INFO: `/v3/projects/0cd65e2f328545eeb7bca886273c1cf1/users/b00d75fe4e8e49b4b8b359ade69b8f5c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.665549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd65e2f328545eeb7bca886273c1cf1, user_id=b00d75fe4e8e49b4b8b359ade69b8f5c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.668229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.680651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1346/2679] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:57 2022] PUT /identity/v3/projects/0cd65e2f328545eeb7bca886273c1cf1/users/b00d75fe4e8e49b4b8b359ade69b8f5c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:57.684633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.694518 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873f2c-3311-4d50-9737-4699a5c0d2ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.749561 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.750117 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.750440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.750711 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.751356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.752922 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a6c4c-7dac-4322-b126-41df17f985b8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.762558 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1334/2680] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:13:57.767289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:57.779145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38260-cb50-4c4a-9cee-42b3a0651f3b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:57.785154 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:57.785897 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:57.786109 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:57.786417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] PATH_INFO: `/v3/projects/0cd65e2f328545eeb7bca886273c1cf1/users/b00d75fe4e8e49b4b8b359ade69b8f5c/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:57.788416 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd65e2f328545eeb7bca886273c1cf1, user_id=b00d75fe4e8e49b4b8b359ade69b8f5c, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:57.791178 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:57.803032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1347/2681] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:13:57 2022] PUT /identity/v3/projects/0cd65e2f328545eeb7bca886273c1cf1/users/b00d75fe4e8e49b4b8b359ade69b8f5c/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:13:58.489493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb39d-1d5e-4ac5-8ea2-0492b796e518 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:58.490365 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb39d-1d5e-4ac5-8ea2-0492b796e518 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:58.490708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb39d-1d5e-4ac5-8ea2-0492b796e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:58.523174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dd1eb39d-1d5e-4ac5-8ea2-0492b796e518 None None] MFA Rules not processed for user `b00d75fe4e8e49b4b8b359ade69b8f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:58.528968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd1eb39d-1d5e-4ac5-8ea2-0492b796e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:58.590204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:58.614142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:13:58.628137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1335/2682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:58.638605 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:58.638924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:58.639402 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:58.661423 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] MFA Rules not processed for user `bcb7635d94f845459d6360d1a4e11004`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:13:58.662795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:58.667762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed42b-4294-4527-8be2-a5923c1668c5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:58.673233 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:58.673952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:58.674399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:58.674747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:58.676700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:58.742823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1336/2683] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:13:58.746388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:13:58.747855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:13:58.758134 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:58.759806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcba43-bc6c-4d1b-9eb3-b265ab22ab41 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:58.769875 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1348/2684] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:13:58.822947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50205-9f66-42dc-95c4-88b8ec7c3caf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:13:58.828778 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:13:58.829394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:13:58.829701 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:13:58.829975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:13:58.837998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:13:58.839604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:13:58.848814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1337/2685] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:00.643388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:00.643831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:00.643913 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:00.671599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] MFA Rules not processed for user `625ae3b2732f4d7ab4dc1badf9881beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:00.673462 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:00.679028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:00.752201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1349/2686] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:00.998023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:01.002484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:01.022550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a14a9-beb8-4dda-bd28-c42022180488 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:01.026132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:01.026773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:01.027053 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:01.027326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:01.029709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:01.039868 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:01.041291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:01.050224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1338/2687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:03.721177 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:03.723302 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:03.750406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3dd54-9dd8-4f85-998a-c8f96552f34d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:03.765519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:03.766199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:03.766521 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:03.767463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] PATH_INFO: `/v3/users/9bf031090a79480291873a34ce703e64` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:03.768275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf031090a79480291873a34ce703e64)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:03.770124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:03.819954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf031090a79480291873a34ce703e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:03.826939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf031090a79480291873a34ce703e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:03.839390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf031090a79480291873a34ce703e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:03.840091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf031090a79480291873a34ce703e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:03.840712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68407bd0-8e14-45e2-88f4-53ce43344b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf031090a79480291873a34ce703e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:03.855344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1350/2688] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:03 2022] DELETE /identity/v3/users/9bf031090a79480291873a34ce703e64 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:04.029783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.055625 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5bf6e-394d-4b00-bc78-7f7dd4014220 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.156519 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.157179 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.157458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.157732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] PATH_INFO: `/v3/projects/97a4039274194c9794738870515ef983` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.159448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a4039274194c9794738870515ef983)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.161490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.177566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:04.231987 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a4039274194c9794738870515ef983', 'request_id': 'req-6443285c-3906-4afd-8aeb-8a158e91e6ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:04.243262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a4039274194c9794738870515ef983', 'request_id': 'req-6443285c-3906-4afd-8aeb-8a158e91e6ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:04.254303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a4039274194c9794738870515ef983', 'request_id': 'req-6443285c-3906-4afd-8aeb-8a158e91e6ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:04.269373 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] The token cache is being invalidate because project 97a4039274194c9794738870515ef983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:04.269703 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:04.270797 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6443285c-3906-4afd-8aeb-8a158e91e6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:04.273253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1339/2689] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:04 2022] DELETE /identity/v3/projects/97a4039274194c9794738870515ef983 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:04.279767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.280588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.281045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.302788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:04.304280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:04.367034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1351/2690] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:04.376034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.376422 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.376630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.398369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:04.399565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:04.409005 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1340/2691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:04.413560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.423794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dcf74-9b53-438b-a93e-140740ee5e28 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.428926 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.429544 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.429818 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.430088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.431021 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:04.431325 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.432987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.445219 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1352/2692] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:04.449807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.459453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff44d4-6943-45da-943e-42965ceeef12 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.464113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.464708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.464985 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.465257 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.465892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.468394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.496311 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1341/2693] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:04.500704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.510902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077285-3e6c-415a-b1b9-ff5e53e9c4e2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.521937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:04.575727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.576804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.577082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.577351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.577990 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.579935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.601960 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1353/2694] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:04.606491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.616720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bafcd-e447-4a97-a974-12767f30d688 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.621367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.621963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.622252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.622538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.623704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.625269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.635004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1342/2695] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:04.639536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.649407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82df6d-2f13-472b-96db-124baf88d5ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.654015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.654683 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.654966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.655240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.655877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.657461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfd14-2d14-4d54-84fa-3e4c7e639164 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.668767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1354/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:04.673010 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.683056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506bf1-c28c-4071-b171-402f93be43b1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.688211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.688856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.689134 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.689406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] PATH_INFO: `/v3/projects/644c308e4e3b43fd8726c00fd9cd3d22/users/7da02bbbace3478a8943fd3a6e4978b5/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.705009 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644c308e4e3b43fd8726c00fd9cd3d22, user_id=7da02bbbace3478a8943fd3a6e4978b5, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.707646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.720740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1343/2697] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:04 2022] PUT /identity/v3/projects/644c308e4e3b43fd8726c00fd9cd3d22/users/7da02bbbace3478a8943fd3a6e4978b5/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:04.731019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.731571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.731680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.766245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] MFA Rules not processed for user `7da02bbbace3478a8943fd3a6e4978b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:04.767503 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:04.851234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1355/2698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:04.855882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.927721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a221-8000-4481-b5aa-8d8c1dd9c455 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:04.932888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:04.933978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:04.934451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:04.934806 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:04.936171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:04.938137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:04.967315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1344/2699] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:04.977526 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:04.994127 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7466-35fd-4f74-a276-e58971f42dd2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.051685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.052310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.052587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.052869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.053748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.055701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.077841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1356/2700] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:04 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:05.081866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.091997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc096d-45ba-4261-a18b-0441373aba9f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.096592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.097214 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.097487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.097755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.098460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.100040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.112128 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1345/2701] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:14:05.116320 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.127280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafbb9-1396-4457-ab37-169f2c32d27a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.132009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.132679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.132953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.133225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] PATH_INFO: `/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3/users/af21a0e4cbf2470abff30a690bddc101/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.143880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:05.151523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16be7a9f9e10441c8a231c1a14cc33b3, user_id=af21a0e4cbf2470abff30a690bddc101, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.154457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.168243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1357/2702] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:05 2022] PUT /identity/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3/users/af21a0e4cbf2470abff30a690bddc101/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:05.173088 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.183548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad6eb-932c-44a4-b70f-eac19cf05adf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.192655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:05.247642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.248867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.249189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.249452 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.250097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.251749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fefc7b-ae0e-422a-ad48-1abdebcd5144 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.263155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1346/2703] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:05.267271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.278322 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c077-a1f6-47a4-be2f-6bc0d3509b51 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.286169 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.286967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.287311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.287645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] PATH_INFO: `/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3/users/af21a0e4cbf2470abff30a690bddc101/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.289625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16be7a9f9e10441c8a231c1a14cc33b3, user_id=af21a0e4cbf2470abff30a690bddc101, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.292439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.304950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1358/2704] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:05 2022] PUT /identity/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3/users/af21a0e4cbf2470abff30a690bddc101/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:05.316901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.317189 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.317464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.351341 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] MFA Rules not processed for user `af21a0e4cbf2470abff30a690bddc101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:05.352514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:05.443741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1347/2705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:05.451667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.453390 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:05.516622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa814bf-d114-49d2-a577-417e86bebf3b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.520648 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.521438 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.521717 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.521989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.532052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.533555 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddfc2d-898c-482a-9e67-636f4837a60d service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.543885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1359/2706] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:05.700322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:05.783100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68dcb-15ce-4cf4-85d5-58d11be43d74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:05.788817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:05.789527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.789872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.790143 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] PATH_INFO: `/v3/users/7da02bbbace3478a8943fd3a6e4978b5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.791310 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da02bbbace3478a8943fd3a6e4978b5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:05.793237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:05.832824 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:05.843707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da02bbbace3478a8943fd3a6e4978b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:05.844428 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da02bbbace3478a8943fd3a6e4978b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:05.852304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da02bbbace3478a8943fd3a6e4978b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:05.868072 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da02bbbace3478a8943fd3a6e4978b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:05.869036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da02bbbace3478a8943fd3a6e4978b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:05.885906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1348/2707] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:05 2022] DELETE /identity/v3/users/7da02bbbace3478a8943fd3a6e4978b5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:05.890723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:05.891228 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:05.891473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:05.910469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:05.911761 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:05.980863 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1360/2708] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:06.000763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:06.003038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:06.070724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dc1b-f17e-4ce1-b579-1c58700f9970 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:06.075514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:06.076212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:06.077011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:06.077011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:06.095178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:06.097921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:06.128872 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1349/2709] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:06.643436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:06.645269 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:06.660983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a061cb2-b090-4034-a3c8-ad934661e30b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:06.670945 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:06.671951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:06.672531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:06.673047 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] PATH_INFO: `/v3/projects/644c308e4e3b43fd8726c00fd9cd3d22` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:06.674713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644c308e4e3b43fd8726c00fd9cd3d22)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:06.676987 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:06.729749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644c308e4e3b43fd8726c00fd9cd3d22', 'request_id': 'req-27746f7d-aaf2-4186-ba39-9567fad07f16'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.738791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644c308e4e3b43fd8726c00fd9cd3d22', 'request_id': 'req-27746f7d-aaf2-4186-ba39-9567fad07f16'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.745864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644c308e4e3b43fd8726c00fd9cd3d22', 'request_id': 'req-27746f7d-aaf2-4186-ba39-9567fad07f16'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.755839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:06.760511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] The token cache is being invalidate because project 644c308e4e3b43fd8726c00fd9cd3d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:06.760800 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.761469 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.763468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1361/2710] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:06 2022] DELETE /identity/v3/projects/644c308e4e3b43fd8726c00fd9cd3d22 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:06.768204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:06.778839 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211b4c6-c880-4283-bc9f-920c83617264 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:06.845921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:06.846580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:06.846988 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:06.847259 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] PATH_INFO: `/v3/users/af21a0e4cbf2470abff30a690bddc101` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:06.848380 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=af21a0e4cbf2470abff30a690bddc101)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:06.850325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:06.905817 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af21a0e4cbf2470abff30a690bddc101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.906496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af21a0e4cbf2470abff30a690bddc101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.915967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af21a0e4cbf2470abff30a690bddc101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.917607 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:06.934842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af21a0e4cbf2470abff30a690bddc101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.935933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6a712dfa-7611-4b47-8a03-03f763edd0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af21a0e4cbf2470abff30a690bddc101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:06.954610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1350/2711] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:06 2022] DELETE /identity/v3/users/af21a0e4cbf2470abff30a690bddc101 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:07.257887 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.259574 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.284304 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746f7d-aaf2-4186-ba39-9567fad07f16 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.342919 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.343567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.343927 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.344223 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] PATH_INFO: `/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.346239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=16be7a9f9e10441c8a231c1a14cc33b3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.349431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.400287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16be7a9f9e10441c8a231c1a14cc33b3', 'request_id': 'req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.409421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16be7a9f9e10441c8a231c1a14cc33b3', 'request_id': 'req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.416778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16be7a9f9e10441c8a231c1a14cc33b3', 'request_id': 'req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.428691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] The token cache is being invalidate because project 16be7a9f9e10441c8a231c1a14cc33b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:07.428981 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.429642 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-516bc4dc-3bf9-4a3e-9140-57f71ebaa3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.431211 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1362/2712] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:07 2022] DELETE /identity/v3/projects/16be7a9f9e10441c8a231c1a14cc33b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:07.436174 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.436743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.436743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.457281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:07.458604 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.519802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1351/2713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:07.527365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.527645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.527911 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.549003 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:07.550206 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.558246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1363/2714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:07.562469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.572198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0936c7-59f4-4eda-88e7-6e649f39e00a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.577222 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.577813 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.578083 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.578378 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.579017 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:07.579315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.580887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.596118 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1352/2715] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:07.597204 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.606245 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cadd0b-3353-449e-9419-06ce613977c6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.612031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.612696 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.613061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.613341 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.614037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.616083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.644327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.646001 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.649383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1364/2716] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:07.653373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.659757 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59b1d-1dc9-45ac-8e29-3b0d9504e720 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.736362 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492ec5-3cab-4839-b770-34725980854c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.737258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.737900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.738223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.738476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] PATH_INFO: `/v3/users/272f0920df6c43ed836b9b8f61119d22` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.739771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=272f0920df6c43ed836b9b8f61119d22)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.741675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.741868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.742488 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.742796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.743063 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.743689 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.745615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.756097 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:07.779195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1365/2717] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:14:07.780989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.795591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622342e-1a9c-4d9f-84e0-0def0aa4ece0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.801226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272f0920df6c43ed836b9b8f61119d22'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.801367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.801608 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272f0920df6c43ed836b9b8f61119d22'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.802591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.802948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.803285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.804277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.806019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.811191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272f0920df6c43ed836b9b8f61119d22'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.818060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1366/2718] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:07.818617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:07.821929 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.827411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.830794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272f0920df6c43ed836b9b8f61119d22'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.831501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4fd45c20-19a9-4728-957f-3b2053498bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272f0920df6c43ed836b9b8f61119d22'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:07.844481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bcc1-d19c-42f3-b2a9-dcd453459d61 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.847006 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1353/2719] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:07 2022] DELETE /identity/v3/users/272f0920df6c43ed836b9b8f61119d22 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:07.849844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.850823 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.851106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.851372 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.851609 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.852010 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.852129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.852320 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.853614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.868494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1367/2720] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:07.869509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.871619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:07.873356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.880287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ae8-e829-46bc-a914-12b77abe0107 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:07.934191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1354/2721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:07.941240 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:07.942057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.942417 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.942694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] PATH_INFO: `/v3/projects/fce7f8c8762d422389ec062510218fc7/users/ca691a950c394a10bea5f747f48c568c/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:07.947768 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:07.949212 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:07.960423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce7f8c8762d422389ec062510218fc7, user_id=ca691a950c394a10bea5f747f48c568c, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:07.964391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e2b56-c897-42ee-9436-edc6fc6f52aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:07.981624 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1368/2722] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:07 2022] PUT /identity/v3/projects/fce7f8c8762d422389ec062510218fc7/users/ca691a950c394a10bea5f747f48c568c/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:07.998870 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:07.999199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:07.999473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.039728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fab4db-2260-4969-8ac2-810c441fd9de None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.047839 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] MFA Rules not processed for user `ca691a950c394a10bea5f747f48c568c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:08.049188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.093297 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.093996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.094507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.094856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.123547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1369/2723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:08.129091 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.159369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:08.178856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.180463 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.182067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:08.192568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1355/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:14:08.205038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b7e88-0763-4103-a7fc-33855e76f339 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.209819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.210547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.210891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.211232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.211938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.213905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.243764 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1370/2725] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:08.248595 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.258601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dae56-4e32-4f6c-957e-fa597dafa63e service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.321236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.321857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.322137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.322458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.323100 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.325037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.351385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1356/2726] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:14:08.355519 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.366442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349e36-9973-4706-8dc8-feb0b44b2304 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.371466 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.372106 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.372378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.372652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.374036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.375986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.388148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1371/2727] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:08.392596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.405064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e822ead-a701-4419-9495-8b11849bde4e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.411696 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.413722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.414161 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.414610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] PATH_INFO: `/v3/projects/a6ac60edc512457e87775080f2a3e551/users/ad0ea35c61ac4763a81c60b485e07f39/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.435105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ac60edc512457e87775080f2a3e551, user_id=ad0ea35c61ac4763a81c60b485e07f39, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.439250 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.456265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1357/2728] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:08 2022] PUT /identity/v3/projects/a6ac60edc512457e87775080f2a3e551/users/ad0ea35c61ac4763a81c60b485e07f39/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:08.460674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.472997 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d0e15-b221-4837-969d-ca3b1d3d80fe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.497312 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.500291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.574121 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.575044 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.575338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.575614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.577199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.578567 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.591492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1372/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:08.594731 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407449ee-96f6-4504-b826-34a0fe8bd5ac admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.596262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.601955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.602663 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.603633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.603912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] PATH_INFO: `/v3/projects/3673b213732a40d296768ee1d734269e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.605224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3673b213732a40d296768ee1d734269e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.607961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.608119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5765db-98e9-4df1-a076-d5fb0a7ca7ed admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.615608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.616985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.617294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.618143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] PATH_INFO: `/v3/projects/a6ac60edc512457e87775080f2a3e551/users/ad0ea35c61ac4763a81c60b485e07f39/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.620915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ac60edc512457e87775080f2a3e551, user_id=ad0ea35c61ac4763a81c60b485e07f39, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.624478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6458d-cffb-4850-a2c7-80609f2abcdb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.637283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1373/2730] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:08 2022] PUT /identity/v3/projects/a6ac60edc512457e87775080f2a3e551/users/ad0ea35c61ac4763a81c60b485e07f39/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:08.650196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.650537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.650917 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.668003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3673b213732a40d296768ee1d734269e', 'request_id': 'req-76f2798f-e99c-4b78-92c3-4c58fe4275b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:08.672531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:08.677226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3673b213732a40d296768ee1d734269e', 'request_id': 'req-76f2798f-e99c-4b78-92c3-4c58fe4275b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:08.683027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] MFA Rules not processed for user `ad0ea35c61ac4763a81c60b485e07f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:08.684237 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.686707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3673b213732a40d296768ee1d734269e', 'request_id': 'req-76f2798f-e99c-4b78-92c3-4c58fe4275b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:08.703132 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] The token cache is being invalidate because project 3673b213732a40d296768ee1d734269e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:08.703588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:08.704545 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76f2798f-e99c-4b78-92c3-4c58fe4275b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:08.706510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1358/2731] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:08 2022] DELETE /identity/v3/projects/3673b213732a40d296768ee1d734269e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:08.711101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4da60-8b04-45d8-85de-4bbd0bb4d3a4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.711588 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4da60-8b04-45d8-85de-4bbd0bb4d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.712264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4da60-8b04-45d8-85de-4bbd0bb4d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.738153 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a8f4da60-8b04-45d8-85de-4bbd0bb4d3a4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:08.739424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a8f4da60-8b04-45d8-85de-4bbd0bb4d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.770635 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1374/2732] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:08.782212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.783961 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.811836 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1359/2733] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:08.817135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:08.819908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.820315 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.820787 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.846385 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:08.847794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.860241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1360/2734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:08.861613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b17e7-4f47-4e7a-80a4-b0254c10713f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.861755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.865559 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.866246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.866628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.866969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.871721 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93b8b-ddc2-4188-a844-d7ae6384eccc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.877990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.878311 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.878822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.879105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.879445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.880086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.880210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:08.880580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.882226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.892566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1375/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:14:08.900178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1361/2736] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:14:08.903319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.916271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dffd35-96a1-4bff-887d-cde3d04b732a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.921827 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.922461 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.922878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.923229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.923805 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:08.925736 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:08.947369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:08.949389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.967514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6737b-58b8-402d-81b1-8728ff82f9aa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:08.972699 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:08.973649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:08.974377 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:08.975004 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:08.978497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1376/2737] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:08.978927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:08.979465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.067523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.069241 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94cb-f23e-4a4b-b5ae-f26dc1424051 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.070105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.077938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.078735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.079119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.079494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.080614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.082724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.087046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1362/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:09.121195 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1377/2739] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:08 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:09.121347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.135123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cbbf4-d87c-454d-956e-44aeac466825 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.143446 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.144213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.144581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.145062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.145828 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.148364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.174038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1363/2740] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:09.178852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.198424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b422-224d-419b-85f3-c2b84bdc2e44 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.205067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.207050 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.207328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.207594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.208745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.211768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bebd5-efb4-400b-a55e-002a1500a5aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.235723 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1378/2741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:09.236195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.251327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce214d-da77-45f7-a965-ba5574006f0a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.263326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.264712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.265340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.265899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] PATH_INFO: `/v3/projects/c30677f3d34d4bcb92f667490914330c/users/6644b6bcf3884b669192f1845efb7f61/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.305628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30677f3d34d4bcb92f667490914330c, user_id=6644b6bcf3884b669192f1845efb7f61, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.309494 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.334190 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1364/2742] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:09 2022] PUT /identity/v3/projects/c30677f3d34d4bcb92f667490914330c/users/6644b6bcf3884b669192f1845efb7f61/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:09.347720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.347720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.347720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.393980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] MFA Rules not processed for user `6644b6bcf3884b669192f1845efb7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:09.396549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:09.486883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1379/2743] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:09.499000 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.541720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:09.581384 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fc0f-228d-4e34-9635-bb5ece619cf6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.585600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.586386 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.586694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.587148 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.596589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.598033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93e01b-534b-4a55-82f7-3027e2efbc11 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.607765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1365/2744] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:09.634222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.648038 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:09.701873 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205992b7-fdf8-4d91-b7f1-edee4acfee49 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.706868 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.707509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.707788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.708061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] PATH_INFO: `/v3/users/6644b6bcf3884b669192f1845efb7f61` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.709217 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6644b6bcf3884b669192f1845efb7f61)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.711243 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.759231 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6644b6bcf3884b669192f1845efb7f61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:09.766104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6644b6bcf3884b669192f1845efb7f61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:09.777676 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6644b6bcf3884b669192f1845efb7f61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:09.778409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6644b6bcf3884b669192f1845efb7f61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:09.779019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6644b6bcf3884b669192f1845efb7f61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:09.792725 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1380/2745] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:09 2022] DELETE /identity/v3/users/6644b6bcf3884b669192f1845efb7f61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:09.797648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.797952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.798240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.818046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:09.819280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:09.880206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1366/2746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:09.890168 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:09.891606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:09.949467 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af931d-10e6-46c7-a75d-c67c42708143 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:09.953507 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:09.954108 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:09.954420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:09.954695 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:09.963778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:09.965209 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cdff1-d4ec-43d8-addf-65c0fa3630ca service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:09.975388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1381/2747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:10.240400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.241968 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:10.257566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4e9e9-bf02-4091-8f30-297ea823668e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.263938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.264971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.265316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.265511 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] PATH_INFO: `/v3/projects/c30677f3d34d4bcb92f667490914330c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.266788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30677f3d34d4bcb92f667490914330c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.268629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.327618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30677f3d34d4bcb92f667490914330c', 'request_id': 'req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:10.336016 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30677f3d34d4bcb92f667490914330c', 'request_id': 'req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:10.342461 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30677f3d34d4bcb92f667490914330c', 'request_id': 'req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:10.353815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] The token cache is being invalidate because project c30677f3d34d4bcb92f667490914330c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:10.354097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:10.354779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c544ebdd-fc6f-4cb1-a724-f9f23db42c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:10.356258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1367/2748] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:10 2022] DELETE /identity/v3/projects/c30677f3d34d4bcb92f667490914330c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:10.361459 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.361888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.362756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.381468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:10.382909 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:10.414030 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:10.444430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1382/2749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:10.454066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.454383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.454658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.474901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:10.476122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:10.484459 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1368/2750] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:10.488898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.505291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028adaf-021a-49a2-ba9b-3770074e229d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.510090 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.510825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.511140 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.511418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.512078 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:10.512381 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.515221 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.528414 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1383/2751] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:10.534137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.547622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4221a6c-664d-4e8b-bea4-ac655e434aab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.552369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.552975 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.553252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.553775 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.554458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.556522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.589525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1369/2752] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:10 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:10.594644 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.605473 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d6a9-3aff-4853-9b1f-d95b55659868 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.738983 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.739603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.739880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.740179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.740812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.742903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.790037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1384/2753] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:10 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:10.794292 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.811244 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a996-0dd9-4497-a08d-ebd11f8c29b8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.820412 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.821275 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.822065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.822481 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.823999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.826686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.844264 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1370/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:10.845814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.857951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fcfb9-1cf8-4cbe-ab4c-1d177a6b2922 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.865740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.867456 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.867741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.868019 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.868957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.871369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc170f45-57b3-4a9a-aa81-ef00545b6714 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.886367 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1385/2755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:10.891307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:10.904977 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec8b2a-f7c0-47ff-b03c-4478b120ab37 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:10.910535 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:10.911398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.911679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.912026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] PATH_INFO: `/v3/projects/ab0ea30645a843eaac99d99e6324155f/users/3e6a9a6835c4466b8ddfa7f85d823fba/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:10.925867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:10.932180 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0ea30645a843eaac99d99e6324155f, user_id=3e6a9a6835c4466b8ddfa7f85d823fba, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:10.936475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:10.956119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1371/2756] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:10 2022] PUT /identity/v3/projects/ab0ea30645a843eaac99d99e6324155f/users/3e6a9a6835c4466b8ddfa7f85d823fba/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:10.967261 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:10.967970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:10.968440 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:11.005737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] MFA Rules not processed for user `3e6a9a6835c4466b8ddfa7f85d823fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:11.007049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:11.104478 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1386/2757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:11.164894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:11.166641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:11.253602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c0c0-69cd-458c-a920-7981bbdc1628 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:11.258382 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:11.258999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:11.259899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:11.259899 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:11.269827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:11.271802 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:11.282585 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1372/2758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:12.513705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:12.524593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bab43-6308-493a-96a2-4e360f8a6871 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:12.528419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:12.529086 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:12.529366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:12.529636 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:12.531646 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:12.573356 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:12.617084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:12.618831 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330f5e2-6cf4-445d-8ed5-f66ef4105f54 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:12.630957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1387/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:12.946841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:12.949457 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:13.022209 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc3e0-004b-4db6-84b1-e6156aaa6415 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:13.026935 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:13.027557 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:13.027830 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:13.028098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] PATH_INFO: `/v3/users/ca691a950c394a10bea5f747f48c568c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:13.029287 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca691a950c394a10bea5f747f48c568c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:13.031218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:13.080673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca691a950c394a10bea5f747f48c568c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.081407 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca691a950c394a10bea5f747f48c568c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.089224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca691a950c394a10bea5f747f48c568c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.103460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca691a950c394a10bea5f747f48c568c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.104343 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca691a950c394a10bea5f747f48c568c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.118700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1373/2760] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:12 2022] DELETE /identity/v3/users/ca691a950c394a10bea5f747f48c568c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:13.123124 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:13.123406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:13.123673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:13.142710 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:13.143900 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:13.218321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1388/2761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:13.235400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:13.236893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:13.251445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:13.299826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4532c-cb3e-4dea-b147-6a966143b7db admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:13.304391 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:13.305041 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:13.305313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:13.305589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:13.315110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:13.316610 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:13.335692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1374/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:13.657862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:13.659386 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:13.674716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4435-8a97-4648-90ec-5107a657a568 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:13.680655 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:13.681572 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:13.681849 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:13.682236 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] PATH_INFO: `/v3/projects/fce7f8c8762d422389ec062510218fc7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:13.683501 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce7f8c8762d422389ec062510218fc7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:13.685534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:13.732629 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce7f8c8762d422389ec062510218fc7', 'request_id': 'req-45426a7a-0a1f-4b93-8038-a78328a8e195'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.740308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce7f8c8762d422389ec062510218fc7', 'request_id': 'req-45426a7a-0a1f-4b93-8038-a78328a8e195'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.746844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce7f8c8762d422389ec062510218fc7', 'request_id': 'req-45426a7a-0a1f-4b93-8038-a78328a8e195'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.757472 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] The token cache is being invalidate because project fce7f8c8762d422389ec062510218fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:13.757760 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.758444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.759916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1389/2763] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:13 2022] DELETE /identity/v3/projects/fce7f8c8762d422389ec062510218fc7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:13.764056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:13.773565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c081e6-8888-4495-ac75-7352d8c6b720 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:13.829544 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:13.830089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:13.830406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:13.830679 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] PATH_INFO: `/v3/users/ad0ea35c61ac4763a81c60b485e07f39` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:13.831776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0ea35c61ac4763a81c60b485e07f39)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:13.833708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:13.878045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0ea35c61ac4763a81c60b485e07f39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.878717 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0ea35c61ac4763a81c60b485e07f39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.885716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0ea35c61ac4763a81c60b485e07f39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.897342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0ea35c61ac4763a81c60b485e07f39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.897976 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd16be54-8352-47b1-809e-78d7b8f1355c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0ea35c61ac4763a81c60b485e07f39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:13.910773 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1375/2764] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:13 2022] DELETE /identity/v3/users/ad0ea35c61ac4763a81c60b485e07f39 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:14.187065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.188571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:14.201980 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426a7a-0a1f-4b93-8038-a78328a8e195 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.247626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:14.261064 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.261727 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.262008 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.262297 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] PATH_INFO: `/v3/projects/a6ac60edc512457e87775080f2a3e551` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.263922 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ac60edc512457e87775080f2a3e551)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.265826 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.315777 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ac60edc512457e87775080f2a3e551', 'request_id': 'req-6eaf03f9-9714-4faa-8065-44ecfbea4718'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:14.324163 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ac60edc512457e87775080f2a3e551', 'request_id': 'req-6eaf03f9-9714-4faa-8065-44ecfbea4718'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:14.331175 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ac60edc512457e87775080f2a3e551', 'request_id': 'req-6eaf03f9-9714-4faa-8065-44ecfbea4718'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:14.342603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] The token cache is being invalidate because project a6ac60edc512457e87775080f2a3e551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:14.342892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:14.343514 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6eaf03f9-9714-4faa-8065-44ecfbea4718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:14.344966 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1390/2765] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:14 2022] DELETE /identity/v3/projects/a6ac60edc512457e87775080f2a3e551 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:14.349821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.350329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.350514 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.369600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:14.370875 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:14.401262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:14.439044 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1376/2766] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:14.446915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.447264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.447549 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.468854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:14.470335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:14.478606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1391/2767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:14.482873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.492745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbfa78-435f-43fc-a97f-1b455266dc27 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.498086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.498735 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.499015 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.499290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.499993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:14.500356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.502025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.515989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1377/2768] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:14.520448 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.529816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21a94-5907-42c6-9698-9ce1ea89c0b4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.534658 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.535262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.535541 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.535814 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.536436 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.538379 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.568485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1392/2769] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:14.572751 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.585756 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b125-76c3-44a2-bf41-ee85cc9fbb45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.666888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.667712 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.667991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.668258 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.668951 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.671140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.694741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1378/2770] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:14.698597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.709738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7824-f694-4b4b-aa7e-e048c344f785 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.715113 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.715714 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.716027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.716288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.716936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.718625 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.729882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1393/2771] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:14:14.734169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.744357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063c8b-5582-4e57-a351-a8772d2b2486 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.751271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.751903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.752484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.752484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.753093 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.754758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177646b-7bef-4d67-afa3-874c0142fb19 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.771540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1379/2772] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:14.777194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:14.790410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a7521-f990-4e4d-b7dc-e65f8c9cdf24 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:14.797002 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:14.797768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.798107 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.798424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] PATH_INFO: `/v3/projects/362cc1b37b9b4880917792e1b31f8930/users/b0bfd12662fa44cea464c74ec7def6c6/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.821196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362cc1b37b9b4880917792e1b31f8930, user_id=b0bfd12662fa44cea464c74ec7def6c6, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:14.824023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:14.838028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1394/2773] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:14 2022] PUT /identity/v3/projects/362cc1b37b9b4880917792e1b31f8930/users/b0bfd12662fa44cea464c74ec7def6c6/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:14.848870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:14.849155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:14.849426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:14.876888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] MFA Rules not processed for user `b0bfd12662fa44cea464c74ec7def6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:14.877971 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:14.949225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1380/2774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:14.954494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.033122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08923e-2aad-47e6-bac0-98c647351f88 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.037694 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.038315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.038593 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.038859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.039525 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.041394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.063595 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:15.072772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1395/2775] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:14 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:15.076984 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.089591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce8a13-d179-4045-941f-53904a446fa4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.119256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:15.155140 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.156615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.156894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.157523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.158154 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.160281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.193822 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1381/2776] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:15 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:14:15.197912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.210143 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c62e-9f33-448b-954e-be88467a1230 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.216677 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.217287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.217561 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.217828 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.218531 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.220129 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.234246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1396/2777] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:15.238322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.254906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781892-c592-4762-8946-a4b7b023935e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.261448 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.261939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.263989 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.264732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.265779 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.267938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56aa19-d99e-484e-8be8-782e7bfa3e66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.289793 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1382/2778] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:15.296184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.311125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280213bc-e53a-4612-8886-7efab3835b43 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.320128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.321102 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.321896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.322300 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] PATH_INFO: `/v3/projects/cce02aa2dda44a669475130d155a7865/users/6ebcc2e5d1fd4317a0a52ed6f88298f1/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.343166 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce02aa2dda44a669475130d155a7865, user_id=6ebcc2e5d1fd4317a0a52ed6f88298f1, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.347587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.364520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1397/2779] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:15 2022] PUT /identity/v3/projects/cce02aa2dda44a669475130d155a7865/users/6ebcc2e5d1fd4317a0a52ed6f88298f1/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:15.376479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.376952 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.377073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.407521 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] MFA Rules not processed for user `6ebcc2e5d1fd4317a0a52ed6f88298f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:15.408948 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:15.476837 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1383/2780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:15.481338 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.543301 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867926a-554f-481f-b35f-7386205fbe5c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.548533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.549147 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.549430 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.549705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.550388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.552419 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.579260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1398/2781] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:15 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:15.583379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.596112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b01eb-398b-4dd4-9c67-3f96ff8af73e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.681600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.682655 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.683095 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.683523 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.685647 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.688037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.718914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1384/2782] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:15 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:15.723579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.737036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9f30-4355-45ca-8b8b-54b77eda0229 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.743452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.744059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.744334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.744601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.745246 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.747286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.759950 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1399/2783] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:15.764177 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.775993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd47f2-10eb-4695-8930-eb2963dcf405 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.782506 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.783305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.783615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.783890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] PATH_INFO: `/v3/projects/79c907bf24094e59ad946d3c86f46ebd/users/ae33f950bd4f4d498d6630a7eaa9ceca/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.799915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c907bf24094e59ad946d3c86f46ebd, user_id=ae33f950bd4f4d498d6630a7eaa9ceca, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.802584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.815926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1385/2784] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:15 2022] PUT /identity/v3/projects/79c907bf24094e59ad946d3c86f46ebd/users/ae33f950bd4f4d498d6630a7eaa9ceca/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:15.819930 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.831056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88942-1f6f-49c6-8093-17b451aa97a7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.889556 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.890203 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.890543 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.890810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.891446 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.893026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296739f3-0f14-470b-af10-af16766e9294 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.903317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1400/2785] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:15.908090 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:15.913487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:15.919254 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b5d4-7c7d-4f03-b576-51afdbe1dfe0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:15.930508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:15.931172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.931447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.931718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] PATH_INFO: `/v3/projects/79c907bf24094e59ad946d3c86f46ebd/users/ae33f950bd4f4d498d6630a7eaa9ceca/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.933746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c907bf24094e59ad946d3c86f46ebd, user_id=ae33f950bd4f4d498d6630a7eaa9ceca, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:15.936411 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:15.946697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1386/2786] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:15 2022] PUT /identity/v3/projects/79c907bf24094e59ad946d3c86f46ebd/users/ae33f950bd4f4d498d6630a7eaa9ceca/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:15.956992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:15.957288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:15.957565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:15.988728 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] MFA Rules not processed for user `ae33f950bd4f4d498d6630a7eaa9ceca`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:15.989965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.014701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:16.064808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1401/2787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:16.076057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:16.078336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.143370 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b92d-c1df-434f-9dc8-9318edccfab8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:16.146937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:16.147538 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:16.147811 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:16.148076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:16.157249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:16.159003 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc49f5a-9c84-4397-9f11-b86ecc6b5e88 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:16.168458 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1387/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:16.394573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:16.395953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.462878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61030b9-4d36-45b1-9621-a0c579346249 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:16.469439 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:16.470171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:16.470482 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:16.470751 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] PATH_INFO: `/v3/users/3e6a9a6835c4466b8ddfa7f85d823fba` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:16.472431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6a9a6835c4466b8ddfa7f85d823fba)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:16.474192 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:16.523434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6a9a6835c4466b8ddfa7f85d823fba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:16.531591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6a9a6835c4466b8ddfa7f85d823fba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:16.543599 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6a9a6835c4466b8ddfa7f85d823fba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:16.544345 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6a9a6835c4466b8ddfa7f85d823fba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:16.544967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6a9a6835c4466b8ddfa7f85d823fba'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:16.560112 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1402/2789] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:16 2022] DELETE /identity/v3/users/3e6a9a6835c4466b8ddfa7f85d823fba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:16.564464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:16.564958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:16.565056 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:16.584348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:16.585628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.649497 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1388/2790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:16.659266 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:16.660640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.672116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:16.673542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.706226 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:16.722674 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b11e-f75a-4afb-b9bb-3a1eb4c9fce4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:16.726331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:16.726934 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:16.727247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:16.727474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:16.732619 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837d577-0e10-4db3-9a7e-6cc6c752870b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:16.736546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:16.737178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:16.737453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:16.737718 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:16.738072 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:16.739529 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:16.739766 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:16.750716 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1403/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:16.792097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:16.811307 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:16.812767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d5ad2-0be2-4f4a-988c-7be85dec1709 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:16.823745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1389/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:14:17.097558 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.098379 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.098613 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.098850 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.099096 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.125135 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ffeb-b4e7-4e21-8dee-69e12fa3f702 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.133972 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:17.134189 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.134908 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.135275 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.135551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] PATH_INFO: `/v3/projects/ab0ea30645a843eaac99d99e6324155f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.136834 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0ea30645a843eaac99d99e6324155f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.137427 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.139095 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.150601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1390/2793] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:17.186715 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.189236 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.239891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0ea30645a843eaac99d99e6324155f', 'request_id': 'req-33eab335-d7d3-42e2-9c60-382121f4ee15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:17.256669 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0ea30645a843eaac99d99e6324155f', 'request_id': 'req-33eab335-d7d3-42e2-9c60-382121f4ee15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:17.264547 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0ea30645a843eaac99d99e6324155f', 'request_id': 'req-33eab335-d7d3-42e2-9c60-382121f4ee15'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:17.281566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] The token cache is being invalidate because project ab0ea30645a843eaac99d99e6324155f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:17.282791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:17.283480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-33eab335-d7d3-42e2-9c60-382121f4ee15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:17.285925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1404/2794] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:17 2022] DELETE /identity/v3/projects/ab0ea30645a843eaac99d99e6324155f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:17.293571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f30f2-c311-4e89-be8c-e2c7da54888a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.293872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f30f2-c311-4e89-be8c-e2c7da54888a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.294748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f30f2-c311-4e89-be8c-e2c7da54888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.310803 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d29d-c71d-44b5-b31c-bb921c41ccb6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.322432 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5a1f30f2-c311-4e89-be8c-e2c7da54888a None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:17.323680 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5a1f30f2-c311-4e89-be8c-e2c7da54888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.393284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6041-6604-4800-a716-947f1006580d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.394172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6041-6604-4800-a716-947f1006580d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.394172 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6041-6604-4800-a716-947f1006580d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.394602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6041-6604-4800-a716-947f1006580d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.396764 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-907f6041-6604-4800-a716-947f1006580d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.414310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1405/2795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:17.422452 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.422944 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.423366 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.447720 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:17.448995 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.458150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1406/2796] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:17.462281 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.471885 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3608b-18bf-4d69-bbd4-1d9fa0bd99a1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.477582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.478194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.478510 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.478782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.479428 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:17.479733 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.481554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.484271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6041-6604-4800-a716-947f1006580d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.485889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6041-6604-4800-a716-947f1006580d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.496617 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1407/2797] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:14:17.501176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1391/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:17.501958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.513120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55f76-9d0f-4c1e-85d9-ffd57a5e22ef admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.520335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.520937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.521220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.521573 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.522076 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.524031 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.554755 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1408/2799] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:17.555882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6041-6604-4800-a716-947f1006580d service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.566025 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6041-6604-4800-a716-947f1006580d service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.574487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:17.625642 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.626369 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.626700 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.627024 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.627678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.629581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.653129 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1392/2800] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:17.654385 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.664667 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901d9e-873b-4e20-afc7-9efdb16cfd02 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.669748 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.670498 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.670724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.671039 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.671640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.673317 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.683759 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1409/2801] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:17.688251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.697999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a1f0-51c2-4188-8ffc-f76c6b122500 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.703150 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.703736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.704011 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.704274 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.704900 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.706491 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a9108-bca9-47ff-8e15-253fbe730b91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.716137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1393/2802] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:17.720200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.730017 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2165-caf3-43b9-8359-cd65c12b7a53 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.735218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.735880 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.736161 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.736433 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] PATH_INFO: `/v3/projects/7db62b1a3b244ea69f0d65c8d86262e0/users/4ac69c7813d945fc9ef4de98b9116dd1/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.747958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:17.752494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db62b1a3b244ea69f0d65c8d86262e0, user_id=4ac69c7813d945fc9ef4de98b9116dd1, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.755253 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.768463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1410/2803] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:17 2022] PUT /identity/v3/projects/7db62b1a3b244ea69f0d65c8d86262e0/users/4ac69c7813d945fc9ef4de98b9116dd1/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:17.773453 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9459fb-acb4-4355-b20c-e4a4f1b71ae4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.773740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9459fb-acb4-4355-b20c-e4a4f1b71ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.774033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9459fb-acb4-4355-b20c-e4a4f1b71ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.792855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fe9459fb-acb4-4355-b20c-e4a4f1b71ae4 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:17.794040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe9459fb-acb4-4355-b20c-e4a4f1b71ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.852460 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1394/2804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:17.862505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:17.864171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:17.919877 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ceae-8bad-4885-9b3e-24bf594f7006 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:17.923533 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:17.924077 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:17.924340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:17.924607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:17.933594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:17.935653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:17.944782 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1411/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:20.457479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:20.458038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:20.458038 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:20.480234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:20.482352 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:20.495353 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1395/2806] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:20.511690 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:20.513630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:20.649851 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9fa5e-fe72-4cbf-8a8d-bafe37d1ad05 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:20.664801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:20.665977 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:20.666896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:20.666896 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:20.685812 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:20.687554 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead64fa0-5281-4bcc-83f9-98438eff5714 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:20.719804 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1412/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:21.079745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:21.081323 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:21.147823 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cdff-8ca9-40f1-bc1c-df9489fb4964 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:21.152556 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:21.153163 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:21.153464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:21.153736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:21.155484 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:21.216098 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:21.251807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:21.253433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:21.264993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1396/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:22.534915 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:22.535758 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:22.536082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:22.566057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] MFA Rules not processed for user `4ac69c7813d945fc9ef4de98b9116dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:22.567351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:22.672992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1413/2809] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:22.678876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:22.696920 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecb743-2058-48a0-965c-bb64a81c9330 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:22.703226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4290750-7969-401b-990c-658346ce36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:22.704467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290750-7969-401b-990c-658346ce36de admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:22.706675 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290750-7969-401b-990c-658346ce36de admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:22.707186 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290750-7969-401b-990c-658346ce36de admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:22.709157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4290750-7969-401b-990c-658346ce36de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:22.713251 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4290750-7969-401b-990c-658346ce36de admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:22.754490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1397/2810] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:22 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:22.755978 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:22.773984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd4a2-707f-4c0d-8f3f-e220e96f0f27 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:22.778551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:22.867588 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:22.868218 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:22.868494 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:22.868763 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:22.869463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:22.872902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:22.910569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1414/2811] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:22 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:22.915406 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4290750-7969-401b-990c-658346ce36de admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:22.938796 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4290750-7969-401b-990c-658346ce36de admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:22.945618 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:22.946573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:22.947115 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:22.947592 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:22.948533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:22.951870 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:22.973782 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1398/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:22.978429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:22.991272 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541bba-9d67-4eb6-9653-20da59787c25 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:22.999715 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:23.000401 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.000938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.000938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] PATH_INFO: `/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae/users/cf74a4e112ea49259e165ecec0a7cb9d/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.019411 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03fae8895bf4850b8ae7ec70f2624ae, user_id=cf74a4e112ea49259e165ecec0a7cb9d, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:23.022530 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:23.036678 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1415/2813] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:22 2022] PUT /identity/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae/users/cf74a4e112ea49259e165ecec0a7cb9d/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:23.040603 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:23.051540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76a3f-524a-40e9-a630-320cc4ccfe66 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:23.112630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:23.113893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.114178 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.114480 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.115120 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:23.116708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0a233-0e0b-4c2d-a361-48d8efe0762b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:23.127127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1399/2814] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:23.131492 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:23.141935 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aeee-a609-4f61-9908-a25cdc0a8739 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:23.146682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:23.147331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.147607 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.147876 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] PATH_INFO: `/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae/users/cf74a4e112ea49259e165ecec0a7cb9d/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.149768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03fae8895bf4850b8ae7ec70f2624ae, user_id=cf74a4e112ea49259e165ecec0a7cb9d, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:23.152485 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:23.162821 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1416/2815] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:23 2022] PUT /identity/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae/users/cf74a4e112ea49259e165ecec0a7cb9d/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:23.681330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.681776 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.681869 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.708375 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:23.709855 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:23.790167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1400/2816] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:23.806881 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:23.808778 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:23.917348 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e154-7b76-466a-a92f-f01350c88d99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:23.925631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:23.926640 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.926924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.927277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.939086 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:23.939799 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:23.940981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:23.941360 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6360f-e95c-4ff7-af4d-6df27005eb7d service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:23.953850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1417/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:14:23.956210 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8accf9-ce3e-4c97-ae85-e63b99b496c3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:23.966400 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:23.967049 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:23.967439 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:23.967723 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] PATH_INFO: `/v3/users/b0bfd12662fa44cea464c74ec7def6c6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:23.968894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bfd12662fa44cea464c74ec7def6c6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:23.970917 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:24.049074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:24.070710 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bfd12662fa44cea464c74ec7def6c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.072033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bfd12662fa44cea464c74ec7def6c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.084360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bfd12662fa44cea464c74ec7def6c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.104728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bfd12662fa44cea464c74ec7def6c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.105573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bfd12662fa44cea464c74ec7def6c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.123403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1401/2818] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:23 2022] DELETE /identity/v3/users/b0bfd12662fa44cea464c74ec7def6c6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:24.128070 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:24.128357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:24.128630 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:24.148806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:24.150743 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:24.219806 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:24.254597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1418/2819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:24.263023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:24.264434 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:24.389548 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fe9a6-d767-496b-a1b1-e3440bbaa220 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:24.398596 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:24.399226 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:24.399503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:24.399771 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:24.422495 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:24.425587 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:24.438780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1402/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:24.756986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:24.764278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:24.793131 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4015d4-6e85-4603-95cb-30fe4ded30dc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:24.800393 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:24.801444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:24.801992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:24.802508 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] PATH_INFO: `/v3/projects/362cc1b37b9b4880917792e1b31f8930` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:24.804214 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362cc1b37b9b4880917792e1b31f8930)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:24.806566 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:24.883260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362cc1b37b9b4880917792e1b31f8930', 'request_id': 'req-4b8876c0-31ca-4956-be23-cc9b44bc9376'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.893255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362cc1b37b9b4880917792e1b31f8930', 'request_id': 'req-4b8876c0-31ca-4956-be23-cc9b44bc9376'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.901603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362cc1b37b9b4880917792e1b31f8930', 'request_id': 'req-4b8876c0-31ca-4956-be23-cc9b44bc9376'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.917645 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] The token cache is being invalidate because project 362cc1b37b9b4880917792e1b31f8930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:24.919893 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.920878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:24.926125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1419/2821] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:24 2022] DELETE /identity/v3/projects/362cc1b37b9b4880917792e1b31f8930 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:24.926923 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:24.938102 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4407c-9905-46ca-9fca-c845d6c96428 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:25.009998 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:25.010594 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:25.010904 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:25.011137 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] PATH_INFO: `/v3/users/6ebcc2e5d1fd4317a0a52ed6f88298f1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:25.012367 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebcc2e5d1fd4317a0a52ed6f88298f1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:25.014372 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:25.073628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebcc2e5d1fd4317a0a52ed6f88298f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.074291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebcc2e5d1fd4317a0a52ed6f88298f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.083704 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebcc2e5d1fd4317a0a52ed6f88298f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.085873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:25.101770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebcc2e5d1fd4317a0a52ed6f88298f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.102630 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebcc2e5d1fd4317a0a52ed6f88298f1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.121105 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1403/2822] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:24 2022] DELETE /identity/v3/users/6ebcc2e5d1fd4317a0a52ed6f88298f1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:25.597923 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:25.599969 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:25.631575 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8876c0-31ca-4956-be23-cc9b44bc9376 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:25.838183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:25.838892 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:25.839165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:25.839441 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] PATH_INFO: `/v3/projects/cce02aa2dda44a669475130d155a7865` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:25.840590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce02aa2dda44a669475130d155a7865)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:25.842770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:25.953028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce02aa2dda44a669475130d155a7865', 'request_id': 'req-8b280658-aec9-4bc7-a18c-3e473ee47a94'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.965111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce02aa2dda44a669475130d155a7865', 'request_id': 'req-8b280658-aec9-4bc7-a18c-3e473ee47a94'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:25.979924 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce02aa2dda44a669475130d155a7865', 'request_id': 'req-8b280658-aec9-4bc7-a18c-3e473ee47a94'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.005034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:26.013706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] The token cache is being invalidate because project cce02aa2dda44a669475130d155a7865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:26.014598 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.017889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.022511 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1420/2823] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:25 2022] DELETE /identity/v3/projects/cce02aa2dda44a669475130d155a7865 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:26.026213 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:26.027765 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:26.045357 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873771-b5f9-486c-9230-cce0daf97fd7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:26.143687 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:26.144852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:26.145342 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:26.145833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] PATH_INFO: `/v3/users/ae33f950bd4f4d498d6630a7eaa9ceca` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:26.147528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae33f950bd4f4d498d6630a7eaa9ceca)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:26.150063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:26.275683 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae33f950bd4f4d498d6630a7eaa9ceca'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.276425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae33f950bd4f4d498d6630a7eaa9ceca'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.293398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae33f950bd4f4d498d6630a7eaa9ceca'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.335649 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae33f950bd4f4d498d6630a7eaa9ceca'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.336418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2d0e5bd-45cf-4c31-9f0f-16a4ff4ab6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae33f950bd4f4d498d6630a7eaa9ceca'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:26.357471 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1404/2824] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:26 2022] DELETE /identity/v3/users/ae33f950bd4f4d498d6630a7eaa9ceca => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:26.781429 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:26.783779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:26.803643 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280658-aec9-4bc7-a18c-3e473ee47a94 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:26.980065 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:26.982770 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:26.983637 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:26.985576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] PATH_INFO: `/v3/projects/79c907bf24094e59ad946d3c86f46ebd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:26.990745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c907bf24094e59ad946d3c86f46ebd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:26.996116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:27.054933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.061583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.062691 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.093281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:27.095074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:27.111573 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1405/2825] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:27.133749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:27.141101 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:27.211650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c907bf24094e59ad946d3c86f46ebd', 'request_id': 'req-420af9b6-226f-4190-bddd-f42ecd8ef135'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:27.235280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c907bf24094e59ad946d3c86f46ebd', 'request_id': 'req-420af9b6-226f-4190-bddd-f42ecd8ef135'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:27.259029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c907bf24094e59ad946d3c86f46ebd', 'request_id': 'req-420af9b6-226f-4190-bddd-f42ecd8ef135'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:27.297353 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] The token cache is being invalidate because project 79c907bf24094e59ad946d3c86f46ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:27.297984 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:27.298712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-420af9b6-226f-4190-bddd-f42ecd8ef135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:27.305523 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1421/2826] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:26 2022] DELETE /identity/v3/projects/79c907bf24094e59ad946d3c86f46ebd => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:27.307026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f46c-182f-4e35-a7c3-ed7855db9295 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.307251 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f46c-182f-4e35-a7c3-ed7855db9295 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.307626 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f46c-182f-4e35-a7c3-ed7855db9295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.340021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:27.369045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-41a3f46c-182f-4e35-a7c3-ed7855db9295 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:27.370306 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41a3f46c-182f-4e35-a7c3-ed7855db9295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:27.391303 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50bf04-9d1c-4801-9eff-50bae636aa37 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:27.520290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1422/2827] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:27.530442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.530726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.531247 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.574936 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:27.577716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.579113 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.579597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:27.579878 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.580953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:27.585256 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:27.605409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1423/2828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:27.610319 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:27.617852 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:27.623890 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:27.628914 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eea27e-0c7e-45b1-aa7c-4b4c2d193f68 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:27.641688 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:27.643791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.643791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.644023 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.645860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:27.646249 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:27.649682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:27.652580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1406/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:27.704307 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1424/2830] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 15:14:27.712272 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:27.748276 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3188-29a8-4659-83d6-dac98be9782f service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:27.764745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:27.766983 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.767266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.767539 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.768191 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:27.770130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:27.835959 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1407/2831] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:27 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:27.839862 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:27.853608 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fcaa-fff8-414b-9176-dad02dd0b580 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:27.863474 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:27.982840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:27.984215 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:27.984602 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:27.984867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:27.985592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:27.988886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.021732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1425/2832] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:27 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:28.027469 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.042570 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85de90c-54df-4bf2-9f7c-2dbbda9d214d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.052364 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.052990 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.053512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.054882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.054882 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.056107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.081149 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1408/2833] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:28.085509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.100232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab047-0eb6-4c0d-b4a9-2c4d72374394 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.117563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.119037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.119528 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.119857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.120580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.122855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcbfe5-8e93-4a9d-8025-6374312a2e8b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.143049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1426/2834] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:28.147133 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.164486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ca78-2e34-4d21-9952-ebc833212d9f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.170252 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.171426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.171912 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.172503 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] PATH_INFO: `/v3/projects/df83e31cab4d49e6847f72cd04ab8a2b/users/bb103be4fea24f5981ae05c05d810a24/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.210424 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df83e31cab4d49e6847f72cd04ab8a2b, user_id=bb103be4fea24f5981ae05c05d810a24, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.214438 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.236863 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1409/2835] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:28 2022] PUT /identity/v3/projects/df83e31cab4d49e6847f72cd04ab8a2b/users/bb103be4fea24f5981ae05c05d810a24/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:28.250854 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.251141 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.251418 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.333579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] MFA Rules not processed for user `bb103be4fea24f5981ae05c05d810a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:28.334936 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:28.493829 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1427/2836] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:28.499934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.631860 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9579-f1ea-4bff-b1e1-4f10640fc280 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.646486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.647112 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.647389 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.647695 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.648291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.650242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.703932 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:28.731007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.745442 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1410/2837] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:28 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:28.755395 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df2f38-5da2-42f9-90ec-a44d00242a2a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.868872 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.869948 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.870422 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.870860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.872495 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.875340 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:28.914151 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1428/2838] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:28 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:28.915280 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:28.929973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52974e-b9d0-45db-a2ed-3eabc6479421 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:28.966532 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:28.974356 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:28.975167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:28.975673 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:28.976756 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:28.979714 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.008663 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.021055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1411/2839] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:14:29.046075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56fead-0b14-4004-bdf4-ae7e2a3ae062 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.046075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.046075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.046075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.046477 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] PATH_INFO: `/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7/users/ddb657aefe464d46a15440f76e7cddf3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.047277 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:29.097400 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1b5d8f5f104fe29c093a420ac1b1b7, user_id=ddb657aefe464d46a15440f76e7cddf3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.100262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.164934 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.166407 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1429/2840] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:29 2022] PUT /identity/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7/users/ddb657aefe464d46a15440f76e7cddf3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:29.182110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a9aa-96da-4791-9f19-18b85b1bbc3b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.302636 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.306483 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.306772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.307048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.307709 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.309876 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d608d-f4fc-4fdd-b8d8-253c413e0bb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.323227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1412/2841] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:29.328841 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.341312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ddca6-f0d9-4067-8525-24129b6c3b2f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.357793 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.358738 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.359173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.359619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] PATH_INFO: `/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7/users/ddb657aefe464d46a15440f76e7cddf3/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.361801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1b5d8f5f104fe29c093a420ac1b1b7, user_id=ddb657aefe464d46a15440f76e7cddf3, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.364989 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977646f-a5a4-40ec-a2f8-8cc29326b8e8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.365347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.365635 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.365902 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.379244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1430/2842] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:29 2022] PUT /identity/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7/users/ddb657aefe464d46a15440f76e7cddf3/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:29.391819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.392100 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.392374 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.403508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] MFA Rules not processed for user `cf74a4e112ea49259e165ecec0a7cb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:29.404758 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:29.425336 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] MFA Rules not processed for user `ddb657aefe464d46a15440f76e7cddf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:29.426713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:29.507295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1413/2843] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:29.515346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1431/2844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:29.522645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.523892 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:29.528406 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.530421 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:29.594137 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73d4f-d36a-4fa9-b029-fcabfc3f80ef None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.597940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.598579 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.598855 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.599125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.602217 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62fb66-1e83-4cab-9a91-b1048dff043e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.607960 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.608564 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.608842 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.609098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.609241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.610571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.611157 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:29.617978 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:29.621119 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1432/2845] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:29.691168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.692831 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6941-c5f8-4c0a-87d7-cd56e132f0e3 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.703482 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1414/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:29.723481 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:29.732985 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb2c-9811-475a-97e7-5a2321f67561 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:29.737032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:29.737623 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:29.737953 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:29.738248 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:29.796684 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:29.799037 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:29.800513 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:29.814615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1433/2847] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:30.360018 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112003-aad2-4e9d-9349-690ddbb84c15 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:30.360569 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112003-aad2-4e9d-9349-690ddbb84c15 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:30.360708 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112003-aad2-4e9d-9349-690ddbb84c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:30.396488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-82112003-aad2-4e9d-9349-690ddbb84c15 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:30.397856 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82112003-aad2-4e9d-9349-690ddbb84c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:30.503057 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1415/2848] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Sep 11 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:30.520056 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:30.522188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:30.541442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1347-a53e-4b9e-b81d-814d70377a7d service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:30.548308 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:30.549735 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:30.550388 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:30.550815 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:30.570457 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:30.572212 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:30.595196 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1434/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:30.938065 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:30.938401 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:30.938807 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:30.961736 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] MFA Rules not processed for user `4ac69c7813d945fc9ef4de98b9116dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:30.963293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:30.973064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1416/2850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:34.602619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:34.604067 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:34.625188 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536444-c7d8-41b5-8175-900edc2ca7fb service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:34.629798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:34.630455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:34.630732 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:34.631004 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] PATH_INFO: `/v3/users/bcb7635d94f845459d6360d1a4e11004` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:34.632118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb7635d94f845459d6360d1a4e11004)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:34.634032 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:34.685153 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb7635d94f845459d6360d1a4e11004'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:34.692737 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb7635d94f845459d6360d1a4e11004'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:34.705116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb7635d94f845459d6360d1a4e11004'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:34.705996 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb7635d94f845459d6360d1a4e11004'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:34.706628 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb7635d94f845459d6360d1a4e11004'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:34.720905 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1435/2851] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:34 2022] DELETE /identity/v3/users/bcb7635d94f845459d6360d1a4e11004 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:34.939318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:34.959271 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ba5b-d97e-4aa9-8a10-ffffac06f88a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:35.068196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:35.069716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.070242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.071358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] PATH_INFO: `/v3/projects/3f5761796a814c95ab1670005c476bc4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.073638 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5761796a814c95ab1670005c476bc4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:35.076800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:35.135267 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:35.135600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.159627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c8925-faf1-4997-afe8-a17561b3c61b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:35.178648 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:35.185464 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5761796a814c95ab1670005c476bc4', 'request_id': 'req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.195956 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5761796a814c95ab1670005c476bc4', 'request_id': 'req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.202996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5761796a814c95ab1670005c476bc4', 'request_id': 'req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.215938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] The token cache is being invalidate because project 3f5761796a814c95ab1670005c476bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:35.217040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.217763 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.223206 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1417/2852] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:34 2022] DELETE /identity/v3/projects/3f5761796a814c95ab1670005c476bc4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:35.225063 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:35.228833 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.257024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:35.258591 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.258878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.259159 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] PATH_INFO: `/v3/users/bb103be4fea24f5981ae05c05d810a24` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.261540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb103be4fea24f5981ae05c05d810a24)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:35.264882 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:35.316713 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5d30-367a-47dc-8d4d-b391d1a0261c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:35.321527 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:35.322176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.322953 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.323241 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] PATH_INFO: `/v3/users/b00d75fe4e8e49b4b8b359ade69b8f5c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.324568 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00d75fe4e8e49b4b8b359ade69b8f5c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:35.326901 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:35.328889 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb103be4fea24f5981ae05c05d810a24'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.344954 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb103be4fea24f5981ae05c05d810a24'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.346099 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:35.364365 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb103be4fea24f5981ae05c05d810a24'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.365171 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb103be4fea24f5981ae05c05d810a24'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.365840 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc381f69-5f13-4dea-aea8-6656fac8fe73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb103be4fea24f5981ae05c05d810a24'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.381560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1436/2853] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:35 2022] DELETE /identity/v3/users/bb103be4fea24f5981ae05c05d810a24 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:35.384296 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00d75fe4e8e49b4b8b359ade69b8f5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.384966 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00d75fe4e8e49b4b8b359ade69b8f5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.385973 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.386262 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.386569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.393176 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00d75fe4e8e49b4b8b359ade69b8f5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.407594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:35.408321 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00d75fe4e8e49b4b8b359ade69b8f5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.408817 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.409033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00d75fe4e8e49b4b8b359ade69b8f5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.423330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1418/2854] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:35 2022] DELETE /identity/v3/users/b00d75fe4e8e49b4b8b359ade69b8f5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:35.475480 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1437/2855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:35.484789 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:35.486204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.549473 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcfec-d5e7-48f6-a93e-d9cd03ab8e41 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:35.553716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:35.554431 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.554745 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.555111 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.560472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:35.599986 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:35.606399 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.624238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44a7ab-bf8f-4cc8-b15c-7d7d3618b4c3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:35.632850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:35.633502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:35.633883 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:35.634174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] PATH_INFO: `/v3/projects/0cd65e2f328545eeb7bca886273c1cf1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:35.635354 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd65e2f328545eeb7bca886273c1cf1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:35.635510 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:35.636986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:35.637289 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:35.648237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1419/2856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 15:14:35.696034 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd65e2f328545eeb7bca886273c1cf1', 'request_id': 'req-c2b554f2-9a32-4d65-800b-b647a864379c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.704654 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd65e2f328545eeb7bca886273c1cf1', 'request_id': 'req-c2b554f2-9a32-4d65-800b-b647a864379c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.711925 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd65e2f328545eeb7bca886273c1cf1', 'request_id': 'req-c2b554f2-9a32-4d65-800b-b647a864379c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.726970 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] The token cache is being invalidate because project 0cd65e2f328545eeb7bca886273c1cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:35.727264 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.727937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:35.729570 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1438/2857] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:35 2022] DELETE /identity/v3/projects/0cd65e2f328545eeb7bca886273c1cf1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:35.958919 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:35.960593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:35.974313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c58d-5737-425d-a008-268a821e6eec service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:36.041142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:36.041720 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.041996 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.042279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] PATH_INFO: `/v3/projects/df83e31cab4d49e6847f72cd04ab8a2b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.043403 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df83e31cab4d49e6847f72cd04ab8a2b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:36.045853 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:36.094393 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df83e31cab4d49e6847f72cd04ab8a2b', 'request_id': 'req-01d95e63-1e27-40f0-ad53-28458f6a497d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.101615 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df83e31cab4d49e6847f72cd04ab8a2b', 'request_id': 'req-01d95e63-1e27-40f0-ad53-28458f6a497d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.107643 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df83e31cab4d49e6847f72cd04ab8a2b', 'request_id': 'req-01d95e63-1e27-40f0-ad53-28458f6a497d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.120048 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] The token cache is being invalidate because project df83e31cab4d49e6847f72cd04ab8a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:36.120362 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.121022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.122584 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1420/2858] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:35 2022] DELETE /identity/v3/projects/df83e31cab4d49e6847f72cd04ab8a2b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:36.126801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:36.128222 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:36.141128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b554f2-9a32-4d65-800b-b647a864379c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:36.194465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:36.201850 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:36.202582 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.203842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.204170 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] PATH_INFO: `/v3/users/ddb657aefe464d46a15440f76e7cddf3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.206104 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb657aefe464d46a15440f76e7cddf3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:36.208465 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:36.260583 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb657aefe464d46a15440f76e7cddf3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.267952 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb657aefe464d46a15440f76e7cddf3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.280382 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb657aefe464d46a15440f76e7cddf3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.281128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb657aefe464d46a15440f76e7cddf3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.281745 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d6844c6-44ac-45d4-8138-dacc8e8624b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb657aefe464d46a15440f76e7cddf3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.296858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1439/2859] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:36 2022] DELETE /identity/v3/users/ddb657aefe464d46a15440f76e7cddf3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:36.632600 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:36.634211 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:36.650627 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95e63-1e27-40f0-ad53-28458f6a497d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:36.682349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:36.713039 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:36.713678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.713955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.714223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] PATH_INFO: `/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.715366 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1b5d8f5f104fe29c093a420ac1b1b7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:36.717913 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:36.765067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1b5d8f5f104fe29c093a420ac1b1b7', 'request_id': 'req-958e46c3-0112-4d20-83b3-2f0394b4e531'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.772335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1b5d8f5f104fe29c093a420ac1b1b7', 'request_id': 'req-958e46c3-0112-4d20-83b3-2f0394b4e531'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.778466 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1b5d8f5f104fe29c093a420ac1b1b7', 'request_id': 'req-958e46c3-0112-4d20-83b3-2f0394b4e531'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.789993 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] The token cache is being invalidate because project 7e1b5d8f5f104fe29c093a420ac1b1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:36.790293 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.790949 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-958e46c3-0112-4d20-83b3-2f0394b4e531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:36.792425 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1421/2860] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:36 2022] DELETE /identity/v3/projects/7e1b5d8f5f104fe29c093a420ac1b1b7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:36.797287 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.797762 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.797871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.817780 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:36.818942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:36.878891 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1440/2861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:36.886898 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.887208 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.887507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.908037 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:36.909255 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:36.917646 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1422/2862] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:36.922378 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:36.932702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58230-60f8-44b0-b755-74fa204a401f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:36.937958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:36.938512 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.938791 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.939061 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.939704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:36.940007 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:36.942286 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:36.956081 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1441/2863] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:36.960436 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:36.969724 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590738b-e041-4d74-abf3-ae7f877ba990 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:36.977462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:36.977462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:36.977462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:36.977462 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:36.978160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:36.978665 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.012435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1423/2864] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:37.017712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.028299 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e4a3f-4b94-4317-b6cd-5532e10023fa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.092551 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.093158 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.093434 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.093702 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.094571 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.096652 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.108118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:37.120705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1442/2865] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:37.125329 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.136963 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ec3ce-2841-458d-9fea-bb400db0aeea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.142142 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.142770 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.143045 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.143426 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.144064 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.145650 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.155741 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1424/2866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:37.159691 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.170118 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde09e4-9c42-4741-b9fa-446f1dff702c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.174810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.175410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.175687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.175957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.176594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.178187 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ff9fe-46d3-4c85-b2b0-92524804090d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.189384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1443/2867] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:37.193612 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.204224 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5c7d-f2e9-4e41-93ab-b7795d731296 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.208781 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.209419 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.209694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.209961 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] PATH_INFO: `/v3/projects/02cc9ee9f62f4124a50c788b7db1cac8/users/d4246cc4d1ec48e3b376afb1800f5c6f/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.225421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cc9ee9f62f4124a50c788b7db1cac8, user_id=d4246cc4d1ec48e3b376afb1800f5c6f, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.228333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.243509 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1425/2868] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:37 2022] PUT /identity/v3/projects/02cc9ee9f62f4124a50c788b7db1cac8/users/d4246cc4d1ec48e3b376afb1800f5c6f/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:37.255423 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.255789 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.256059 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.286029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] MFA Rules not processed for user `d4246cc4d1ec48e3b376afb1800f5c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:37.287284 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:37.351536 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1444/2869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:37.355999 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.416160 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:37.420743 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e6efe-64eb-44bb-9ab5-83a2c42df9bb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.426476 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.427281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.427788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.428077 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.429227 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.431231 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.460198 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1426/2870] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:37.462234 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.473116 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0827-f010-4037-ace5-077d568f8f83 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.530022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de17f-b090-4824-8552-353fed32397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.530792 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de17f-b090-4824-8552-353fed32397a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.531069 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de17f-b090-4824-8552-353fed32397a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.531337 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de17f-b090-4824-8552-353fed32397a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.531974 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de17f-b090-4824-8552-353fed32397a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.534066 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de17f-b090-4824-8552-353fed32397a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.557679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1445/2871] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:37.561299 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.571784 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97228a3d-3ef7-40c0-8fcc-663cfeae9d44 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.576390 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.576991 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.577266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.577533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.578195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.579791 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.590326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1427/2872] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:37.594860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de17f-b090-4824-8552-353fed32397a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.605239 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de17f-b090-4824-8552-353fed32397a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.612194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.612194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.612194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.612194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.612767 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.613964 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34f6b6-fa80-4bd8-96b0-77c706a25827 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.624772 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1446/2873] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:37.629409 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.639555 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd139-e9a3-4d3c-8f0d-bab79d6887f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.644162 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.644818 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.645091 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.645360 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] PATH_INFO: `/v3/projects/fab9ef5c8e2343a88d1a8c2599a8d4fa/users/293bb00565f546b187d7a069dc3e133c/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.664467 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab9ef5c8e2343a88d1a8c2599a8d4fa, user_id=293bb00565f546b187d7a069dc3e133c, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.667151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.683496 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1428/2874] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:37 2022] PUT /identity/v3/projects/fab9ef5c8e2343a88d1a8c2599a8d4fa/users/293bb00565f546b187d7a069dc3e133c/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:37.752486 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.752754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.753026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.783874 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] MFA Rules not processed for user `293bb00565f546b187d7a069dc3e133c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:37.785110 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:37.825201 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:37.849844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1447/2875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:37.854513 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.915702 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dcf5-bd25-48ee-ba2f-eb8999660109 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:37.921130 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:37.921744 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:37.922023 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:37.922322 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:37.922997 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:37.924889 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:37.952262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1429/2876] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:37.956454 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:37.968939 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9f5c-5aa3-4516-abd5-24f0315c8185 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.027603 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.028213 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.028489 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.029442 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.030120 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.032191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.053122 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1448/2877] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:37 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:38.057219 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:38.067957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c465-ea8f-4c8d-9f97-fd3bc1afb5eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.072628 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.073225 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.073501 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.073772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.074441 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.076645 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.087827 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1430/2878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:38.092587 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:38.103080 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e794a4-a9da-409f-8c49-a85b52cc2f92 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.107807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.108298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.108604 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.108859 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] PATH_INFO: `/v3/projects/2107579a7a2847c2965346aabc337d74/users/8b32df73053649c192e62edff1635ac7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.124951 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2107579a7a2847c2965346aabc337d74, user_id=8b32df73053649c192e62edff1635ac7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.127921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.141199 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1449/2879] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:38 2022] PUT /identity/v3/projects/2107579a7a2847c2965346aabc337d74/users/8b32df73053649c192e62edff1635ac7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:38.145182 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:38.155808 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942cd5b-cb20-41f9-8dd0-b418ed6b3848 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.211522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.212168 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.212445 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.212737 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.213394 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.215022 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e659af8-4542-4c86-bf7d-27a99d27a717 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.225992 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1431/2880] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:38.230740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:38.241075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505f91-56e0-47af-83f4-64ecc27dfedd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.245918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.246600 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.246879 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.247150 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] PATH_INFO: `/v3/projects/2107579a7a2847c2965346aabc337d74/users/8b32df73053649c192e62edff1635ac7/roles/06cb7c5bf25a4456a6d24ca3b67b6350` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.249148 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2107579a7a2847c2965346aabc337d74, user_id=8b32df73053649c192e62edff1635ac7, role_id=06cb7c5bf25a4456a6d24ca3b67b6350)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.251861 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.262704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1450/2881] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:38 2022] PUT /identity/v3/projects/2107579a7a2847c2965346aabc337d74/users/8b32df73053649c192e62edff1635ac7/roles/06cb7c5bf25a4456a6d24ca3b67b6350 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:38.273355 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.273641 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.273914 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.305302 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] MFA Rules not processed for user `8b32df73053649c192e62edff1635ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:38.305669 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:38.311122 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:38.376844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1432/2882] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:38.388783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:38.390540 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:38.448193 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1dfde-29e7-4bff-b3ea-d9299c46ff23 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:38.452412 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:38.453016 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:38.453291 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:38.453560 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:38.498255 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:38.510916 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:38.512408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:38.522318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1451/2883] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:40.078127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:40.089593 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ad745-9416-4af5-8c3e-2d32a60301c0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:40.094880 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:40.095475 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:40.095754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:40.096043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:40.172278 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:40.174164 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:40.188097 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1433/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:40.808232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:40.817089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0f58-58c6-4dcf-af77-0c657c3a774a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:40.820819 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:40.821424 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:40.821704 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:40.821972 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:40.831190 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:40.832615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e3595-4bdc-4a8d-92eb-b85afdeda394 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:40.843156 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1452/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:44.715677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:44.784266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a800b6-4fc1-47e3-bb7a-220b0ff9a6bf service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:44.788858 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:44.789493 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:44.789772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:44.790046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] PATH_INFO: `/v3/users/d4246cc4d1ec48e3b376afb1800f5c6f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:44.791196 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4246cc4d1ec48e3b376afb1800f5c6f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:44.793107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:44.839465 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:44.842728 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4246cc4d1ec48e3b376afb1800f5c6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:44.843581 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4246cc4d1ec48e3b376afb1800f5c6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:44.850931 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4246cc4d1ec48e3b376afb1800f5c6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:44.863080 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4246cc4d1ec48e3b376afb1800f5c6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:44.863873 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4246cc4d1ec48e3b376afb1800f5c6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:44.877894 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1434/2886] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:44 2022] DELETE /identity/v3/users/d4246cc4d1ec48e3b376afb1800f5c6f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 15:14:44.882534 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:44.883024 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:44.883133 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:44.902550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:44.903713 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:44.963580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1453/2887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:14:44.976507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:44.976507 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:45.034725 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335196-fd0a-4202-890f-662bc1b45f0e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:45.038444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:45.039051 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:45.039328 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:45.039598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:45.049455 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:45.050955 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:45.061327 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1435/2888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:45.356036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:45.357601 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:45.371145 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee09d-6807-4cba-b0b1-af7873b7d17c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:45.377565 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:45.378200 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:45.378522 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:45.378788 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] PATH_INFO: `/v3/projects/02cc9ee9f62f4124a50c788b7db1cac8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:45.379902 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cc9ee9f62f4124a50c788b7db1cac8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:45.382563 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:45.436771 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cc9ee9f62f4124a50c788b7db1cac8', 'request_id': 'req-0be209a0-41a7-4457-9766-e96536320fa9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.444045 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cc9ee9f62f4124a50c788b7db1cac8', 'request_id': 'req-0be209a0-41a7-4457-9766-e96536320fa9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.450622 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cc9ee9f62f4124a50c788b7db1cac8', 'request_id': 'req-0be209a0-41a7-4457-9766-e96536320fa9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.463740 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] The token cache is being invalidate because project 02cc9ee9f62f4124a50c788b7db1cac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:45.464357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.465184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.467105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1454/2889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:45 2022] DELETE /identity/v3/projects/02cc9ee9f62f4124a50c788b7db1cac8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:45.470995 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:45.494804 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85743-3a50-4179-9bb9-1611f0849074 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:45.561279 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:45.561911 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:45.562184 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:45.562490 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] PATH_INFO: `/v3/users/293bb00565f546b187d7a069dc3e133c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:45.563598 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] RBAC: Authorizing `identity:delete_user(user_id=293bb00565f546b187d7a069dc3e133c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:45.565512 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:45.616243 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293bb00565f546b187d7a069dc3e133c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.617281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293bb00565f546b187d7a069dc3e133c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.626030 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293bb00565f546b187d7a069dc3e133c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.633399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:45.640110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293bb00565f546b187d7a069dc3e133c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.641110 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293bb00565f546b187d7a069dc3e133c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:45.654218 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1436/2890] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:45 2022] DELETE /identity/v3/users/293bb00565f546b187d7a069dc3e133c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:45.943455 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:45.945035 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:45.960309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be209a0-41a7-4457-9766-e96536320fa9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:46.021060 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:46.027830 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:46.028697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:46.029084 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:46.029586 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] PATH_INFO: `/v3/projects/fab9ef5c8e2343a88d1a8c2599a8d4fa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:46.031111 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab9ef5c8e2343a88d1a8c2599a8d4fa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:46.033094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:46.082810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab9ef5c8e2343a88d1a8c2599a8d4fa', 'request_id': 'req-a49a5e56-61de-477f-ac8f-6dbfc34158d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.090675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab9ef5c8e2343a88d1a8c2599a8d4fa', 'request_id': 'req-a49a5e56-61de-477f-ac8f-6dbfc34158d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.097869 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab9ef5c8e2343a88d1a8c2599a8d4fa', 'request_id': 'req-a49a5e56-61de-477f-ac8f-6dbfc34158d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.109726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] The token cache is being invalidate because project fab9ef5c8e2343a88d1a8c2599a8d4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:46.110015 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.110681 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.112162 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1455/2891] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:45 2022] DELETE /identity/v3/projects/fab9ef5c8e2343a88d1a8c2599a8d4fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:46.116066 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:46.117577 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:46.131171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75512d6-3188-4e72-9797-9e97ce0b556c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:46.189957 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:46.190629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:46.190903 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:46.191167 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] PATH_INFO: `/v3/users/8b32df73053649c192e62edff1635ac7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:46.192266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b32df73053649c192e62edff1635ac7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:46.194155 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:46.239716 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b32df73053649c192e62edff1635ac7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.240281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b32df73053649c192e62edff1635ac7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.247151 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b32df73053649c192e62edff1635ac7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.259633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b32df73053649c192e62edff1635ac7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.260262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5aa3244d-cf3c-4477-bdf2-0c76449f6e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b32df73053649c192e62edff1635ac7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.272753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1437/2892] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:46 2022] DELETE /identity/v3/users/8b32df73053649c192e62edff1635ac7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:46.569328 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:46.570958 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:46.588464 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5e56-61de-477f-ac8f-6dbfc34158d2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:46.737502 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:46.742075 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:46.743312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:46.744160 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] PATH_INFO: `/v3/projects/2107579a7a2847c2965346aabc337d74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:46.762296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2107579a7a2847c2965346aabc337d74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:46.762296 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:46.841383 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2107579a7a2847c2965346aabc337d74', 'request_id': 'req-3904b8a2-caee-4be5-a443-dd3de0f9a852'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.852679 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2107579a7a2847c2965346aabc337d74', 'request_id': 'req-3904b8a2-caee-4be5-a443-dd3de0f9a852'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.860244 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2107579a7a2847c2965346aabc337d74', 'request_id': 'req-3904b8a2-caee-4be5-a443-dd3de0f9a852'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.871921 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] The token cache is being invalidate because project 2107579a7a2847c2965346aabc337d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:14:46.872597 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.873653 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3904b8a2-caee-4be5-a443-dd3de0f9a852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:46.875638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1456/2893] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:14:46 2022] DELETE /identity/v3/projects/2107579a7a2847c2965346aabc337d74 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:46.881686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:46.882028 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:46.882338 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:46.902472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:46.903682 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:46.966926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1438/2894] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:46.974673 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:46.975194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:46.975194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.002052 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:47.003370 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:47.012739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1457/2895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:47.016946 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.022237 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:47.028347 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c55c95-83fd-4bb5-952d-7b92fac8c26b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.041877 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.042697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.043026 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.043290 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.044036 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:14:47.044339 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.046572 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.059563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1439/2896] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:14:47.065786 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.077468 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19211ef1-10e1-44b8-b7b5-bdc1fecf2774 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.082532 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.083149 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.083425 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.084580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.084580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.086357 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.105309 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:47.130342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1458/2897] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:14:47 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:14:47.133979 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.146304 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddb17-41a5-4c24-af53-09b424a33367 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.206639 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.207336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.207617 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.207887 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.208526 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.210472 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.233398 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1440/2898] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:14:47 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:14:47.237754 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.249682 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022219fb-b91f-4343-9723-6426428938e3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.254852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.255484 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.255768 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.256042 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.256843 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.258509 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.270094 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1459/2899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:47.274059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.285314 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd47d1-c5a3-4a70-9df5-596977eac023 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.290553 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.291346 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.291629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.291905 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.292560 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.294175 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67dc5-93ba-43bf-afd0-05d4793eb32c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.306397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1441/2900] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:14:47.310594 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.325318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b351d-088d-4092-947e-3382765da93f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.330606 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.331398 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.331741 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.332068 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] PATH_INFO: `/v3/projects/138a7327b5914f7ba181ab3d07b40b36/users/04fb623f430847429dfb370d750bdf14/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.350181 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138a7327b5914f7ba181ab3d07b40b36, user_id=04fb623f430847429dfb370d750bdf14, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.353006 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.369592 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1460/2901] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:14:47 2022] PUT /identity/v3/projects/138a7327b5914f7ba181ab3d07b40b36/users/04fb623f430847429dfb370d750bdf14/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:14:47.382076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403d10-d004-48d4-a9f1-5926081f2a6c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.382664 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403d10-d004-48d4-a9f1-5926081f2a6c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.383121 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403d10-d004-48d4-a9f1-5926081f2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.416238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fa403d10-d004-48d4-a9f1-5926081f2a6c None None] MFA Rules not processed for user `04fb623f430847429dfb370d750bdf14`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:47.417566 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fa403d10-d004-48d4-a9f1-5926081f2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:47.486318 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1442/2902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:47.497089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:47.499500 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:47.566342 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf4675-f7e9-4aa5-8503-d4c8a3ad0bf4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:47.569938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:47.570580 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:47.570857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:47.571126 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:47.579933 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:47.581346 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:47.590529 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1461/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:49.051266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:49.051767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:49.051866 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:49.071171 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] MFA Rules not processed for user `04fb623f430847429dfb370d750bdf14`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:14:49.072348 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:49.079795 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1443/2904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:14:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:14:57.001389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:57.002943 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:57.060886 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebe15-ccba-4680-9788-a9d1ad23d1d9 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:57.064431 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:57.065026 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:57.065316 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:57.065564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:57.067310 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:57.132577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:57.134043 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:57.144402 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1462/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:59.065897 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:59.127747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:59.130926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:59.224223 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd2a0c-241d-45ec-b006-39163293ec1b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:59.229895 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:59.230486 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:59.230769 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:59.231040 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:59.232821 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:59.248967 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:59.250670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:59.267678 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1444/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:14:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:14:59.821779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:14:59.823619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:14:59.835796 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:14:59.909144 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b5af-2985-463e-ad2d-ea8a3685df92 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:14:59.914577 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:14:59.915335 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:14:59.915724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:14:59.916088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] PATH_INFO: `/v3/users/625ae3b2732f4d7ab4dc1badf9881beb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:14:59.917463 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625ae3b2732f4d7ab4dc1badf9881beb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:14:59.920093 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:14:59.974697 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625ae3b2732f4d7ab4dc1badf9881beb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:14:59.995146 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625ae3b2732f4d7ab4dc1badf9881beb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.011283 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625ae3b2732f4d7ab4dc1badf9881beb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.012058 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625ae3b2732f4d7ab4dc1badf9881beb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.012675 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6650027f-0b39-4434-b85b-4a0f8719cd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625ae3b2732f4d7ab4dc1badf9881beb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.032254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1463/2907] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:14:59 2022] DELETE /identity/v3/users/625ae3b2732f4d7ab4dc1badf9881beb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:00.218662 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:00.235330 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff570-0d7a-4f79-9398-ca5ee9f6296d service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:00.296200 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:00.296746 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:00.297019 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:00.297286 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] PATH_INFO: `/v3/projects/03febcd4ac7249c1aa8871cfaf8fcc5b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:00.298447 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03febcd4ac7249c1aa8871cfaf8fcc5b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:00.300397 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:00.351888 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03febcd4ac7249c1aa8871cfaf8fcc5b', 'request_id': 'req-28e31664-a030-4795-b0e1-341ebc16930f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.359927 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03febcd4ac7249c1aa8871cfaf8fcc5b', 'request_id': 'req-28e31664-a030-4795-b0e1-341ebc16930f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.365622 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03febcd4ac7249c1aa8871cfaf8fcc5b', 'request_id': 'req-28e31664-a030-4795-b0e1-341ebc16930f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.378062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] The token cache is being invalidate because project 03febcd4ac7249c1aa8871cfaf8fcc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:15:00.378450 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.379589 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:00.381644 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1445/2908] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:15:00 2022] DELETE /identity/v3/projects/03febcd4ac7249c1aa8871cfaf8fcc5b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:04.429685 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a7d9-93a3-41d6-a233-beb5c1eae96d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:04.430179 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a7d9-93a3-41d6-a233-beb5c1eae96d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:04.430298 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a7d9-93a3-41d6-a233-beb5c1eae96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:04.449128 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-69d8a7d9-93a3-41d6-a233-beb5c1eae96d None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:04.450351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-69d8a7d9-93a3-41d6-a233-beb5c1eae96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:04.503808 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1464/2909] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:04.550926 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:04.552316 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:04.571123 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:04.621281 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31664-a030-4795-b0e1-341ebc16930f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:04.626668 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:04.627265 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:04.627540 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:04.627815 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:04.636479 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:04.638722 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:04.647076 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1446/2910] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:15:05.136938 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6504-18a6-4155-8eb6-55fb89bd88b2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.137225 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6504-18a6-4155-8eb6-55fb89bd88b2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.137497 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6504-18a6-4155-8eb6-55fb89bd88b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.157542 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-32cb6504-18a6-4155-8eb6-55fb89bd88b2 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:05.158701 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-32cb6504-18a6-4155-8eb6-55fb89bd88b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:05.165884 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1465/2911] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:05.178930 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:05.189937 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3fe1-81b1-4264-a1e2-33141641f9c6 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:05.197550 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:05.198139 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.198567 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.198841 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.207194 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:05.209074 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:05.217089 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1447/2912] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:15:05.437729 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390966-50f9-46ed-872a-12a240a2be3e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.438184 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390966-50f9-46ed-872a-12a240a2be3e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.438315 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390966-50f9-46ed-872a-12a240a2be3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.456867 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ea390966-50f9-46ed-872a-12a240a2be3e None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:05.458036 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea390966-50f9-46ed-872a-12a240a2be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:05.465057 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1466/2913] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:05.477487 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:05.488671 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9ec1-7b54-429b-9e8f-5f68957e6f91 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:05.493670 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:05.494262 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.494565 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.494835 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.502752 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:05.504313 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:05.512106 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1448/2914] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:15:05.824813 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.825114 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.825871 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.844878 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] MFA Rules not processed for user `2caac9bd22464e2cbb6668357c0fe101`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:05.846049 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:05.852967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1467/2915] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:05.865033 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:05.875801 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1008a-482d-4c98-a7ca-5fb91ef30fcd service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:05.880783 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f8f0c6b4b049debb3e963dd3b7916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:05.881383 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:05.881661 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:05.881933 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:05.890388 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:05.891944 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddebdb-3f4c-4f22-b0f0-fc3e3379091b service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:05.899814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1449/2916] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 15:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 15:15:07.963686 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:07.965082 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:07.979444 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:08.033590 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c427c6e-b77e-4bbc-8923-cd6e2196c372 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.038071 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.038724 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.039001 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.039271 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] PATH_INFO: `/v3/users/04fb623f430847429dfb370d750bdf14` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.040397 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fb623f430847429dfb370d750bdf14)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.042347 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.088165 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fb623f430847429dfb370d750bdf14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.095816 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fb623f430847429dfb370d750bdf14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.109224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fb623f430847429dfb370d750bdf14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.109224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fb623f430847429dfb370d750bdf14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.109224 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fb623f430847429dfb370d750bdf14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.122389 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1468/2917] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:15:07 2022] DELETE /identity/v3/users/04fb623f430847429dfb370d750bdf14 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:08.127087 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.127601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.127707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.146772 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:08.147947 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:08.204591 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1450/2918] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:08.214194 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.215615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:08.272229 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bba1b-f624-4b33-8b65-47f649aef894 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.275890 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.276490 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.276784 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.277029 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.286516 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.287937 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3535a99-8f96-4b18-880e-4f773581e147 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.297164 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1469/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:15:08.460747 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.462195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:08.474046 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d487f05-af76-44f6-a9f2-de9080f1f56f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.479116 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.479755 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.480034 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.480305 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] PATH_INFO: `/v3/projects/138a7327b5914f7ba181ab3d07b40b36` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.481559 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138a7327b5914f7ba181ab3d07b40b36)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.483488 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.530602 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138a7327b5914f7ba181ab3d07b40b36', 'request_id': 'req-f5a239d5-9516-450c-9e4d-9741dc2c2707'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.537563 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138a7327b5914f7ba181ab3d07b40b36', 'request_id': 'req-f5a239d5-9516-450c-9e4d-9741dc2c2707'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.541614 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:08.543844 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138a7327b5914f7ba181ab3d07b40b36', 'request_id': 'req-f5a239d5-9516-450c-9e4d-9741dc2c2707'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.556421 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] The token cache is being invalidate because project 138a7327b5914f7ba181ab3d07b40b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:15:08.556707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.557387 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5a239d5-9516-450c-9e4d-9741dc2c2707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:08.558924 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1451/2920] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:15:08 2022] DELETE /identity/v3/projects/138a7327b5914f7ba181ab3d07b40b36 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:08.564288 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.564576 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.564852 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.585079 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:08.586290 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:08.615173 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:08.649083 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1470/2921] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:08.656516 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.656800 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.657073 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.676826 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:08.678021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:08.686738 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1452/2922] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 15:15:08.690864 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.700408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613c2c-b0a0-4d7b-bddb-f174b62e4b57 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.704955 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.705537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.705810 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.706073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.706795 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 15:15:08.707040 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.708609 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.719807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1471/2923] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 15:15:08.723854 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.733405 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70028-ed59-4409-8dc3-c66b77c76b6f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.738067 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.738694 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.738969 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.739239 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.739867 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.741732 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.768794 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1453/2924] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 15:15:08.772940 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.783105 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2c7ca-f869-4159-b10e-819354cabd40 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.838413 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.839252 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.839537 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.839803 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.840420 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.842408 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.863858 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1472/2925] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 15:15:08.867973 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.878921 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629832f-b8b8-4344-b4ea-3981d32bdb39 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.883677 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.884269 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.884542 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.884809 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.885440 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.887081 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.897861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1454/2926] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 15:15:08.901746 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.911662 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16218d8-5bcc-4851-b35a-ffab1c940619 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.916260 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.916845 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.917125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.917394 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.918022 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.919638 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9247-96f9-4877-8676-58d4066991cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.930844 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1473/2927] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 15:15:08.934697 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:08.944925 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073b9d6-239e-418d-b1da-2c78e0f1f808 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:08.949416 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:08.950043 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.950358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.950629 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] PATH_INFO: `/v3/projects/60ff6ae0b66744ae83ed30a9e3e78c9d/users/254ad7616b9e4172a6f2667d8e7b71c5/roles/44a03d54df6f4580a9f4933398e65018` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:08.964651 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ff6ae0b66744ae83ed30a9e3e78c9d, user_id=254ad7616b9e4172a6f2667d8e7b71c5, role_id=44a03d54df6f4580a9f4933398e65018)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:08.967238 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:08.981938 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1455/2928] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 15:15:08 2022] PUT /identity/v3/projects/60ff6ae0b66744ae83ed30a9e3e78c9d/users/254ad7616b9e4172a6f2667d8e7b71c5/roles/44a03d54df6f4580a9f4933398e65018 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:08.992610 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:08.993088 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:08.993191 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:09.021361 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] MFA Rules not processed for user `254ad7616b9e4172a6f2667d8e7b71c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:09.022613 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:09.083749 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1474/2929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:09.094986 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:09.096620 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:09.155554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe691d-f5c9-4a69-afc3-fb51c52c75dd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:09.159195 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff83fd91f594d97af82492a1eb344af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:09.159814 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:09.160092 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:09.160358 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:09.168562 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:09.169981 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963ea9-d9d8-4ea0-bdf0-7b3bff544519 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:09.179525 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1456/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:15:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:15:19.080888 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:19.175295 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=1,keystone:SELECT=57,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:19.191615 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:19.254687 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74aef-3d49-4c2b-9e3e-49f572b42f3e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:19.259089 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:19.259712 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:19.259992 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:19.260263 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] PATH_INFO: `/v3/users/254ad7616b9e4172a6f2667d8e7b71c5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:19.261369 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=254ad7616b9e4172a6f2667d8e7b71c5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:19.263321 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:19.309185 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254ad7616b9e4172a6f2667d8e7b71c5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.316706 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254ad7616b9e4172a6f2667d8e7b71c5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.328232 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254ad7616b9e4172a6f2667d8e7b71c5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.328903 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254ad7616b9e4172a6f2667d8e7b71c5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.329504 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254ad7616b9e4172a6f2667d8e7b71c5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.342779 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1475/2931] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:15:19 2022] DELETE /identity/v3/users/254ad7616b9e4172a6f2667d8e7b71c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:19.347240 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:19.347508 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:19.347777 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:19.366707 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] MFA Rules not processed for user `9abde477b352443096596e97b4877ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 15:15:19.367884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:19.424918 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1457/2932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 15:15:19.434708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:19.436092 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:19.492798 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262af6-d3e7-4212-8c21-f34e002a1cbd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:19.496373 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:19.496963 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:19.497238 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:19.497505 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:19.506329 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:19.507807 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:19.517009 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1476/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:15:19.778857 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:19.780340 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:19.793634 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cd0cf-8b14-4f19-8a0c-eb85bd3e676d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:19.798950 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:19.799583 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:19.799885 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:19.800249 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] PATH_INFO: `/v3/projects/60ff6ae0b66744ae83ed30a9e3e78c9d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:19.801374 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ff6ae0b66744ae83ed30a9e3e78c9d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:19.803893 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:19.851126 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ff6ae0b66744ae83ed30a9e3e78c9d', 'request_id': 'req-ae534fd4-34c7-4294-a1c4-65f591d1b34a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.858059 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ff6ae0b66744ae83ed30a9e3e78c9d', 'request_id': 'req-ae534fd4-34c7-4294-a1c4-65f591d1b34a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.863740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ff6ae0b66744ae83ed30a9e3e78c9d', 'request_id': 'req-ae534fd4-34c7-4294-a1c4-65f591d1b34a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.886021 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] The token cache is being invalidate because project 60ff6ae0b66744ae83ed30a9e3e78c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:15:19.886336 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.886958 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:15:19.888433 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1458/2934] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:15:19 2022] DELETE /identity/v3/projects/60ff6ae0b66744ae83ed30a9e3e78c9d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:15:29.512898 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:29.883861 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:15:37.288783 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:15:37.290210 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:37.423857 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025309-9d25-4408-a0b1-e07b80aabe67 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:15:37.481450 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:15:37.482046 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:15:37.482351 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:15:37.482627 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:15:37.484312 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:15:37.495616 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:15:37.497174 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:15:37.507415 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1477/2935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:15:47.503270 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:20.706879 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:20.709533 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:20.852266 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534fd4-34c7-4294-a1c4-65f591d1b34a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:20.860749 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456e7e3006f14407ac65e432ace7286d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:20.861522 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:20.861843 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:20.862119 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:20.864654 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:20.879169 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:20.880754 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:20.892601 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1459/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:18:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:18:20.908621 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:20.910073 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:20.995614 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea3e4f-8d51-46f0-85bf-0c34431394fe service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:20.999157 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:20.999753 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:21.000027 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:21.000294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:21.002011 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:21.016183 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:21.017631 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:21.029387 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1478/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:18:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:18:21.863884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:21.865435 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:21.876686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd1b6-e496-48e8-ac62-bf2059473674 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:21.880767 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:21.881349 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:21.881621 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:21.881884 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:21.883551 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:21.892580 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:21.894032 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:21.901915 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1460/2938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:18:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:18:22.214294 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:22.223569 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc096d-03f6-45b9-aaee-d33a916a7e15 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:22.227331 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c3fd3f0f2c4c48a9ced12e4ef9f950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:22.228410 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:22.228700 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:22.228971 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:22.230747 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:22.244912 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:22.246384 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:22.257842 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1479/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:18:30.828158 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:30.830816 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:30.847829 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102bfa4-8a0f-44fd-90e4-bf9821fe8f71 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:30.855444 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:30.856253 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:30.856753 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:30.857284 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:30.861489 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:30.879242 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:30.880939 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:30.891537 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1461/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:18:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:18:30.906708 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:30.908719 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:31.006705 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec46d3-0387-4403-870b-fe5566d3b8fa service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:31.011334 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:31.011967 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:31.012278 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:31.012550 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] PATH_INFO: `/v3/users/4ac69c7813d945fc9ef4de98b9116dd1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:31.013726 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac69c7813d945fc9ef4de98b9116dd1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:31.015739 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:31.072280 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac69c7813d945fc9ef4de98b9116dd1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.077564 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:31.079756 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac69c7813d945fc9ef4de98b9116dd1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.093285 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac69c7813d945fc9ef4de98b9116dd1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.093965 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac69c7813d945fc9ef4de98b9116dd1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.094632 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac69c7813d945fc9ef4de98b9116dd1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.106860 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1480/2941] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:18:30 2022] DELETE /identity/v3/users/4ac69c7813d945fc9ef4de98b9116dd1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:18:31.277906 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:31.289528 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9038c-62b2-48bd-b2ec-7d1f80c0e252 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:31.347062 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:31.347686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:31.347962 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:31.348234 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] PATH_INFO: `/v3/projects/7db62b1a3b244ea69f0d65c8d86262e0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:31.349333 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db62b1a3b244ea69f0d65c8d86262e0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:31.351260 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:31.361908 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:31.398554 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db62b1a3b244ea69f0d65c8d86262e0', 'request_id': 'req-10e0e127-b8ac-4903-a877-f7b12bcc0197'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.405740 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db62b1a3b244ea69f0d65c8d86262e0', 'request_id': 'req-10e0e127-b8ac-4903-a877-f7b12bcc0197'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.411451 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db62b1a3b244ea69f0d65c8d86262e0', 'request_id': 'req-10e0e127-b8ac-4903-a877-f7b12bcc0197'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.422399 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] The token cache is being invalidate because project 7db62b1a3b244ea69f0d65c8d86262e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:18:31.422686 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.423326 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.424788 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1462/2942] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:18:31 2022] DELETE /identity/v3/projects/7db62b1a3b244ea69f0d65c8d86262e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:18:31.429957 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:31.431453 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:31.445250 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bae71-d4ad-4c25-a91c-acebedca10f0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:31.499825 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:31.500377 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:31.500650 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:31.500918 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] PATH_INFO: `/v3/users/cf74a4e112ea49259e165ecec0a7cb9d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:31.502028 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf74a4e112ea49259e165ecec0a7cb9d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:31.504651 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:31.548693 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf74a4e112ea49259e165ecec0a7cb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.556409 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf74a4e112ea49259e165ecec0a7cb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.569125 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf74a4e112ea49259e165ecec0a7cb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.569794 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf74a4e112ea49259e165ecec0a7cb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.570435 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf74a4e112ea49259e165ecec0a7cb9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.582801 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1481/2943] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 15:18:31 2022] DELETE /identity/v3/users/cf74a4e112ea49259e165ecec0a7cb9d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:18:31.753692 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:18:31.755204 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:18:31.769658 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e127-b8ac-4903-a877-f7b12bcc0197 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:18:31.826127 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9abde477b352443096596e97b4877ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7334057aea374090aa685d1856ec911f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:18:31.826780 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:18:31.827055 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:18:31.827325 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] PATH_INFO: `/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:18:31.828418 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03fae8895bf4850b8ae7ec70f2624ae)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:18:31.830335 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:18:31.876107 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03fae8895bf4850b8ae7ec70f2624ae', 'request_id': 'req-9010d105-a733-4200-8d21-e50009793d21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.882928 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03fae8895bf4850b8ae7ec70f2624ae', 'request_id': 'req-9010d105-a733-4200-8d21-e50009793d21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.888546 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03fae8895bf4850b8ae7ec70f2624ae', 'request_id': 'req-9010d105-a733-4200-8d21-e50009793d21'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.899246 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] The token cache is being invalidate because project f03fae8895bf4850b8ae7ec70f2624ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 15:18:31.899531 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.900146 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9010d105-a733-4200-8d21-e50009793d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 15:18:31.901633 dv-cinder-856971-1-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1463/2944] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 15:18:31 2022] DELETE /identity/v3/projects/f03fae8895bf4850b8ae7ec70f2624ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 15:18:41.579344 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=62,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:18:41.896291 dv-cinder-856971-1-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 15:20:41.015941 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 15:20:41.017318 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:20:41.086098 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407087-9276-4d7e-96e1-a078e60fff0d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 15:20:41.143836 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b33447fc1e41e1bf083519b827cdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424d0a4464c64d5995512badce1e3346', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 15:20:41.144942 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 15:20:41.145220 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 15:20:41.145487 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 15:20:41.147235 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 15:20:41.158391 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 15:20:41.160619 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f1fde-1a3d-4909-a12b-3f7f1e020cdc service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 15:20:41.170520 dv-cinder-856971-1-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1482/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 15:20:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 15:20:51.166254 dv-cinder-856971-1-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=58 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}